![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4683 originally caused by: Started by upstream project "master-osmo-trx" build number 4892 originally caused by: Started by upstream project "master-libusrp" build number 1828 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7510 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6690 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8713 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8959 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2986 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29305 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5155 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30089 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4683 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12989 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9255 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4710 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8041 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5537 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins14641410972342245494.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-13 15:37:47 + trial_dir_prefix=trial- + rm -rf trial-2390 trial-2390-bin.tgz trial-2390-run.tgz + trial_dir=trial-2391 + mkdir -p trial-2391 + mv open5gs.build-8.tgz osmo-bsc.build-17680.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2986.tgz osmo-mgw.build-8959.tgz osmo-msc.build-29305.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30089.tgz osmo-stp.build-9255.tgz osmo-trx.build-4683.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz trial-2391 + cat open5gs.build-8.md5 osmo-bsc.build-17680.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2986.md5 osmo-mgw.build-8959.md5 osmo-msc.build-29305.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30089.md5 osmo-stp.build-9255.md5 osmo-trx.build-4683.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17680.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2986.md5 osmo-mgw.build-8959.md5 osmo-msc.build-29305.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30089.md5 osmo-stp.build-9255.md5 osmo-trx.build-4683.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2391 combinations: None trial: 'trial-2391' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2391 -------------------------------------------------------------------------------------------- 15:37:59.024090 tst trial-2391: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/log --------------------------------------------------------------------- trial-2391 nitb_sms:sysmo --------------------------------------------------------------------- 15:40:09.198852 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:09.202443 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 15:40:09.223106 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 15:40:09.229887 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 15:40:09.290500 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 15:40:09.311951 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 15:40:09.318734 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 15:40:09.852061 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 15:40:09.857107 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 15:40:09.867837 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 15:40:10.242135 tst mo_mt_sms.py: using LAC 34586 15:40:10.479259 tst mo_mt_sms.py: using RAC 161 15:40:10.609872 tst mo_mt_sms.py: using CellId 34586 15:40:10.734830 tst mo_mt_sms.py: using BVCI 34587 15:40:10.852204 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 15:40:11.035945 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 15:40:11.154201 tst mo_mt_sms.py:9: start nitb and bts... 15:40:11.359851 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:40:13.603807 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1247): Launched 15:40:13.915818 run osmo-nitb_10.42.42.2(pid=1248): Launched 15:40:14.085504 run osmo-nitb_10.42.42.2(pid=1248): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1248)] 15:40:14.212089 run osmo-nitb_10.42.42.2(pid=1248): stdout: | (launched: 2022-12-13_15:40:13.858011) 15:40:14.340044 run osmo-nitb_10.42.42.2(pid=1248): stderr: | (launched: 2022-12-13_15:40:13.903732) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:40:14.467895 run osmo-nitb_10.42.42.2(pid=1248): stdout: | (launched: 2022-12-13_15:40:13.858011) 15:40:14.590168 run osmo-nitb_10.42.42.2(pid=1248): stderr: | (launched: 2022-12-13_15:40:13.903732) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:40:14.736757 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1248): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1248) [trial-2391↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1248)] [trial-2391↪nitb_sms:sysmo↪mo_mt_sms.py:11] 15:40:14.745216 tst mo_mt_sms.py:11: Test FAILED (4.9 sec) 15:40:14.751889 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1247): Terminating (SIGTERM) 15:40:14.961803 --- ParallelTerminationStrategy: PID 1247 died... 15:40:14.982975 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1247): Terminated: ok {rc=0} 15:40:15.068931 bus /sierra_3: Setting Powered False 15:40:16.177663 bus /sierra_3: Setting Powered False 15:40:17.297878 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 sms:sysmo --------------------------------------------------------------------- 15:40:18.481491 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:18.485880 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 15:40:18.507401 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 15:40:18.535378 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 15:40:18.588877 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 15:40:18.610874 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 15:40:18.638308 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 15:40:19.186712 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 sms:sysmo mo_mt_sms.py ---------------------------------------------- 15:40:19.192170 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:40:19.203699 tst sms:sysmo: Using 1 x bts (candidates: 1) 15:40:19.239296 tst mo_mt_sms.py: using LAC 34587 15:40:19.368199 tst mo_mt_sms.py: using RAC 162 15:40:19.497497 tst mo_mt_sms.py: using CellId 34587 15:40:19.621635 tst mo_mt_sms.py: using BVCI 34588 15:40:19.735574 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:40:19.746251 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:40:19.756700 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:40:19.767214 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:40:19.777677 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:40:19.788744 tst sms:sysmo: Using 1 x modem (candidates: 2) 15:40:19.910821 tst sms:sysmo: Using 1 x modem (candidates: 2) 15:40:20.031993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:21.762268 run create_hlr_db(pid=1254): Launched 15:40:21.881728 bus /sierra_2: Setting Powered False 15:40:22.943068 run create_hlr_db(pid=1254): Terminated: ok {rc=0} 15:40:23.395534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1256): Launched 15:40:23.729417 run osmo-hlr_10.42.42.2(pid=1257): Launched 15:40:23.857749 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:26.454199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1259): Launched 15:40:26.786047 run osmo-stp_10.42.42.5(pid=1260): Launched 15:40:26.912081 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:32.417760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1262): Launched 15:40:32.725594 run osmo-msc_10.42.42.6(pid=1263): Launched 15:40:32.897277 run osmo-stp_10.42.42.5(pid=1260): ERR: Terminated: ERROR {rc=1} [trial-2391↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1260)] 15:40:33.027184 run osmo-stp_10.42.42.5(pid=1260): stdout: | (launched: 2022-12-13_15:40:26.723755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:33.157109 run osmo-stp_10.42.42.5(pid=1260): stderr: | [0;m[38;5;43m20221213154026921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154026921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154026921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154026921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154026922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154026922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154026922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:33.284360 run osmo-stp_10.42.42.5(pid=1260): stdout: | (launched: 2022-12-13_15:40:26.723755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:33.406130 run osmo-stp_10.42.42.5(pid=1260): stderr: | [0;m[38;5;43m20221213154026921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154026921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154026921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154026921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154026922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154026922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154026922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:33.552119 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1260): Process ended prematurely: osmo-stp_10.42.42.5(pid=1260) [trial-2391↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1260)] [trial-2391↪sms:sysmo↪mo_mt_sms.py:16] 15:40:33.560609 tst mo_mt_sms.py:16: Test FAILED (14.4 sec) 15:40:33.586976 run osmo-hlr_10.42.42.2(pid=1257): ERR: Terminated: ERROR {rc=237} [trial-2391↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1257)] 15:40:33.635647 run osmo-hlr_10.42.42.2(pid=1257): stdout: | (launched: 2022-12-13_15:40:23.667027) 15:40:33.685521 run osmo-hlr_10.42.42.2(pid=1257): stderr: | [0;m[1;31m20221213154023873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154023873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154023873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154023873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154023873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154023873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154023885 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154023893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154023894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154023894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:33.755084 run osmo-msc_10.42.42.6(pid=1263): ERR: Terminated: ERROR {rc=2} [trial-2391↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1263)] 15:40:33.803186 run osmo-msc_10.42.42.6(pid=1263): stdout: | (launched: 2022-12-13_15:40:32.668286) 15:40:33.853300 run osmo-msc_10.42.42.6(pid=1263): stderr: | [0;m[38;5;43m20221213154032946 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154032946 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdbda24cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154032946 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154032946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154032946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154032947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154032949 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154032949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154032949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154032949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:33.903548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1256): Terminating (SIGTERM) 15:40:33.943843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1259): Terminating (SIGTERM) 15:40:33.984110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1262): Terminating (SIGTERM) 15:40:34.025594 --- ParallelTerminationStrategy: PID 1256 died... 15:40:34.045389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1256): Terminated: ok {rc=0} 15:40:34.090349 --- ParallelTerminationStrategy: PID 1259 died... 15:40:34.109607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1259): Terminated: ok {rc=0} 15:40:34.154554 --- ParallelTerminationStrategy: PID 1262 died... 15:40:34.173761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1262): Terminated: ok {rc=0} 15:40:34.261280 bus /sierra_3: Setting Powered False 15:40:35.361042 bus /sierra_3: Setting Powered False 15:40:36.478263 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_ussd:sysmo --------------------------------------------------------------------- 15:40:37.699918 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:37.703994 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 15:40:37.725122 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 15:40:37.731916 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 15:40:37.766691 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 15:40:37.788521 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 15:40:37.795260 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 15:40:38.318756 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2391 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 15:40:38.324738 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 15:40:38.336341 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 15:40:38.370467 tst assert_extension.py: using LAC 34588 15:40:38.491321 tst assert_extension.py: using RAC 163 15:40:38.610624 tst assert_extension.py: using CellId 34588 15:40:38.733335 tst assert_extension.py: using BVCI 34589 15:40:38.854134 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 15:40:38.971993 tst assert_extension.py:10: start nitb and bts... 15:40:39.179660 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:40:39.808178 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1268): Launched 15:40:40.120157 run osmo-nitb_10.42.42.2(pid=1269): Launched 15:40:40.292057 run osmo-nitb_10.42.42.2(pid=1269): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1269)] 15:40:40.430083 run osmo-nitb_10.42.42.2(pid=1269): stdout: | (launched: 2022-12-13_15:40:40.061922) 15:40:40.569898 run osmo-nitb_10.42.42.2(pid=1269): stderr: | (launched: 2022-12-13_15:40:40.107778) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:40:40.709458 run osmo-nitb_10.42.42.2(pid=1269): stdout: | (launched: 2022-12-13_15:40:40.061922) 15:40:40.843431 run osmo-nitb_10.42.42.2(pid=1269): stderr: | (launched: 2022-12-13_15:40:40.107778) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1269): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1269) [trial-2391↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1269)] 15:40:41.237607 tst osmo-nitb_10.42.42.2(pid=1269): stdout: | (launched: 2022-12-13_15:40:40.061922) 15:40:41.362406 tst osmo-nitb_10.42.42.2(pid=1269): stderr: | (launched: 2022-12-13_15:40:40.107778) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:40:41.509757 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1269): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1269) [trial-2391↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1269)] [trial-2391↪nitb_ussd:sysmo↪assert_extension.py:12] 15:40:41.518422 tst assert_extension.py:12: Test FAILED (3.2 sec) 15:40:41.525419 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1268): Terminating (SIGTERM) 15:40:41.736220 --- ParallelTerminationStrategy: PID 1268 died... 15:40:41.757220 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1268): Terminated: ok {rc=0} 15:40:41.846539 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 ussd:sysmo --------------------------------------------------------------------- 15:40:43.018438 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:43.022207 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 15:40:43.043557 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 15:40:43.071604 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 15:40:43.105757 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 15:40:43.126901 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 15:40:43.153681 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 15:40:43.683265 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2391 ussd:sysmo assert_extension.py ---------------------------------------------- 15:40:43.688503 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:40:43.699212 tst ussd:sysmo: Using 1 x bts (candidates: 1) 15:40:43.733314 tst assert_extension.py: using LAC 34589 15:40:43.854823 tst assert_extension.py: using RAC 164 15:40:43.976761 tst assert_extension.py: using CellId 34589 15:40:44.096346 tst assert_extension.py: using BVCI 34590 15:40:44.208085 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:40:44.218866 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:40:44.229425 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:40:44.239858 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:40:44.251204 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:40:44.262609 tst ussd:sysmo: Using 1 x modem (candidates: 1) 15:40:44.383740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:44.896380 run create_hlr_db(pid=1273): Launched 15:40:45.031705 bus /sierra_2: Setting Powered False 15:40:46.096694 run create_hlr_db(pid=1273): Terminated: ok {rc=0} 15:40:46.624937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1275): Launched 15:40:46.957877 run osmo-hlr_10.42.42.2(pid=1276): Launched 15:40:47.195785 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:47.733338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1278): Launched 15:40:48.044032 run osmo-stp_10.42.42.5(pid=1279): Launched 15:40:48.163316 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:48.722777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1281): Launched 15:40:49.035135 run osmo-msc_10.42.42.6(pid=1282): Launched 15:40:49.210815 run osmo-stp_10.42.42.5(pid=1279): ERR: Terminated: ERROR {rc=1} [trial-2391↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1279)] 15:40:49.342175 run osmo-stp_10.42.42.5(pid=1279): stdout: | (launched: 2022-12-13_15:40:47.985827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:49.472567 run osmo-stp_10.42.42.5(pid=1279): stderr: | [0;m[38;5;43m20221213154048181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154048181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154048182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154048182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154048182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154048183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154048183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:49.601305 run osmo-stp_10.42.42.5(pid=1279): stdout: | (launched: 2022-12-13_15:40:47.985827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:49.723913 run osmo-stp_10.42.42.5(pid=1279): stderr: | [0;m[38;5;43m20221213154048181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154048181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154048182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154048182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154048182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154048183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154048183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:49.871332 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1279): Process ended prematurely: osmo-stp_10.42.42.5(pid=1279) [trial-2391↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1279)] [trial-2391↪ussd:sysmo↪assert_extension.py:17] 15:40:49.879772 tst assert_extension.py:17: Test FAILED (6.2 sec) 15:40:49.905746 run osmo-hlr_10.42.42.2(pid=1276): ERR: Terminated: ERROR {rc=237} [trial-2391↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1276)] 15:40:49.954928 run osmo-hlr_10.42.42.2(pid=1276): stdout: | (launched: 2022-12-13_15:40:46.898802) 15:40:50.005512 run osmo-hlr_10.42.42.2(pid=1276): stderr: | [0;m[1;31m20221213154047218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154047218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154047218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154047218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154047218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154047218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154047231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154047239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154047239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154047239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:50.075598 run osmo-msc_10.42.42.6(pid=1282): ERR: Terminated: ERROR {rc=2} [trial-2391↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1282)] 15:40:50.124284 run osmo-msc_10.42.42.6(pid=1282): stdout: | (launched: 2022-12-13_15:40:48.976500) 15:40:50.174594 run osmo-msc_10.42.42.6(pid=1282): stderr: | [0;m[38;5;43m20221213154049250 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154049250 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6264fccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154049250 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154049250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154049250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154049250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154049252 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154049252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154049253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154049253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:50.225045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1275): Terminating (SIGTERM) 15:40:50.265324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1278): Terminating (SIGTERM) 15:40:50.305644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1281): Terminating (SIGTERM) 15:40:50.346056 --- ParallelTerminationStrategy: PID 1275 died... 15:40:50.365488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1275): Terminated: ok {rc=0} 15:40:50.409693 --- ParallelTerminationStrategy: PID 1278 died... 15:40:50.428563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1278): Terminated: ok {rc=0} 15:40:50.472856 --- ParallelTerminationStrategy: PID 1281 died... 15:40:50.492291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1281): Terminated: ok {rc=0} 15:40:50.578982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:40:51.778737 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:51.786389 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:40:51.808010 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:40:51.836054 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:40:51.889190 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:40:51.910718 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:40:51.939340 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:40:52.491127 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:40:52.548622 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:52.560446 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:40:52.622563 tst mo_mt_call.py: using LAC 34590 15:40:52.756268 tst mo_mt_call.py: using RAC 165 15:40:52.886268 tst mo_mt_call.py: using CellId 34590 15:40:53.018140 tst mo_mt_call.py: using BVCI 34591 15:40:53.139455 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:53.151221 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:53.162844 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:53.177449 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:53.191909 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:53.206939 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:40:53.333430 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:40:53.452048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:53.940876 run create_hlr_db(pid=1287): Launched 15:40:54.064018 bus /sierra_2: Setting Powered False 15:40:55.126768 run create_hlr_db(pid=1287): Terminated: ok {rc=0} 15:40:55.586993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1289): Launched 15:40:55.926887 run osmo-hlr_10.42.42.2(pid=1290): Launched 15:40:56.057581 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:56.636298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1292): Launched 15:40:56.973610 run osmo-stp_10.42.42.5(pid=1293): Launched 15:40:57.102998 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:57.708699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1295): Launched 15:40:58.047490 run osmo-msc_10.42.42.6(pid=1296): Launched 15:40:58.234839 run osmo-stp_10.42.42.5(pid=1293): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1293)] 15:40:58.437704 run osmo-stp_10.42.42.5(pid=1293): stdout: | (launched: 2022-12-13_15:40:56.911179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:58.600909 run osmo-stp_10.42.42.5(pid=1293): stderr: | [0;m[38;5;43m20221213154057109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154057109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154057109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154057110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154057110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154057110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154057110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:58.732599 run osmo-stp_10.42.42.5(pid=1293): stdout: | (launched: 2022-12-13_15:40:56.911179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:58.857919 run osmo-stp_10.42.42.5(pid=1293): stderr: | [0;m[38;5;43m20221213154057109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154057109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154057109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154057110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154057110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154057110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154057110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:59.008131 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1293): Process ended prematurely: osmo-stp_10.42.42.5(pid=1293) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1293)] [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:40:59.017405 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:40:59.044336 run osmo-hlr_10.42.42.2(pid=1290): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1290)] 15:40:59.093709 run osmo-hlr_10.42.42.2(pid=1290): stdout: | (launched: 2022-12-13_15:40:55.864358) 15:40:59.144332 run osmo-hlr_10.42.42.2(pid=1290): stderr: | [0;m[1;31m20221213154056067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154056067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154056067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154056067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154056067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154056067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154056094 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154056105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154056105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154056105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:59.215120 run osmo-msc_10.42.42.6(pid=1296): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1296)] 15:40:59.263433 run osmo-msc_10.42.42.6(pid=1296): stdout: | (launched: 2022-12-13_15:40:57.984222) 15:40:59.313846 run osmo-msc_10.42.42.6(pid=1296): stderr: | [0;m[38;5;43m20221213154058309 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154058309 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe953185c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154058309 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154058309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154058309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154058309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154058311 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154058312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154058312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154058312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:59.365091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1289): Terminating (SIGTERM) 15:40:59.405873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1292): Terminating (SIGTERM) 15:40:59.446749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1295): Terminating (SIGTERM) 15:40:59.488170 --- ParallelTerminationStrategy: PID 1289 died... 15:40:59.507937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1289): Terminated: ok {rc=0} 15:40:59.553211 --- ParallelTerminationStrategy: PID 1292 died... 15:40:59.572353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1292): Terminated: ok {rc=0} 15:40:59.617130 --- ParallelTerminationStrategy: PID 1295 died... 15:40:59.636283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1295): Terminated: ok {rc=0} 15:40:59.722697 bus /sierra_3: Setting Powered False 15:41:00.820894 bus /sierra_3: Setting Powered False 15:41:01.939151 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:41:03.085309 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:41:03.097181 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:41:03.154600 tst mo_mt_call_osmux.py: using LAC 34591 15:41:03.278773 tst mo_mt_call_osmux.py: using RAC 166 15:41:03.403828 tst mo_mt_call_osmux.py: using CellId 34591 15:41:03.531488 tst mo_mt_call_osmux.py: using BVCI 34592 15:41:03.647319 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:41:03.658637 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:41:03.670222 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:41:03.681714 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:41:03.693642 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:41:03.704619 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:41:03.848011 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:41:03.979419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:04.505948 run create_hlr_db(pid=1298): Launched 15:41:04.631907 bus /sierra_2: Setting Powered False 15:41:05.698869 run create_hlr_db(pid=1298): Terminated: ok {rc=0} 15:41:06.169931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1300): Launched 15:41:06.508508 run osmo-hlr_10.42.42.2(pid=1301): Launched 15:41:06.639455 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:07.221483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1303): Launched 15:41:07.560196 run osmo-stp_10.42.42.5(pid=1304): Launched 15:41:07.690243 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:08.302408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1306): Launched 15:41:08.640021 run osmo-msc_10.42.42.6(pid=1307): Launched 15:41:08.828639 run osmo-stp_10.42.42.5(pid=1304): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1304)] 15:41:08.969854 run osmo-stp_10.42.42.5(pid=1304): stdout: | (launched: 2022-12-13_15:41:07.497560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:09.112133 run osmo-stp_10.42.42.5(pid=1304): stderr: | [0;m[38;5;43m20221213154107695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154107695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154107695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154107696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154107696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154107696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154107696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:09.252801 run osmo-stp_10.42.42.5(pid=1304): stdout: | (launched: 2022-12-13_15:41:07.497560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:09.386741 run osmo-stp_10.42.42.5(pid=1304): stderr: | [0;m[38;5;43m20221213154107695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154107695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154107695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154107696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154107696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154107696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154107696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:09.546801 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1304): Process ended prematurely: osmo-stp_10.42.42.5(pid=1304) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1304)] [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:41:09.556550 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:41:09.585405 run osmo-hlr_10.42.42.2(pid=1301): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1301)] 15:41:09.636827 run osmo-hlr_10.42.42.2(pid=1301): stdout: | (launched: 2022-12-13_15:41:06.445934) 15:41:09.690344 run osmo-hlr_10.42.42.2(pid=1301): stderr: | [0;m[1;31m20221213154106649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154106649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154106649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154106649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154106649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154106649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154106663 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154106674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154106674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154106674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:09.764476 run osmo-msc_10.42.42.6(pid=1307): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1307)] 15:41:09.815870 run osmo-msc_10.42.42.6(pid=1307): stdout: | (launched: 2022-12-13_15:41:08.577404) 15:41:09.869139 run osmo-msc_10.42.42.6(pid=1307): stderr: | [0;m[38;5;43m20221213154108907 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154108907 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff2088d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154108907 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154108907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154108908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154108908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154108910 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154108910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154108910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154108910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:09.922377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1300): Terminating (SIGTERM) 15:41:09.965136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1303): Terminating (SIGTERM) 15:41:10.008085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1306): Terminating (SIGTERM) 15:41:10.051275 --- ParallelTerminationStrategy: PID 1300 died... 15:41:10.071647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1300): Terminated: ok {rc=0} 15:41:10.119862 --- ParallelTerminationStrategy: PID 1303 died... 15:41:10.140017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1303): Terminated: ok {rc=0} 15:41:10.187394 --- ParallelTerminationStrategy: PID 1306 died... 15:41:10.207367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1306): Terminated: ok {rc=0} 15:41:10.296581 bus /sierra_3: Setting Powered False 15:41:11.395334 bus /sierra_3: Setting Powered False 15:41:12.513750 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:41:13.756411 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:13.763433 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:41:13.785099 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:41:13.812938 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:41:13.868526 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:41:13.890120 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:41:13.917467 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:41:14.472002 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:41:14.526567 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:14.538322 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:41:14.596566 tst mo_mt_call.py: using LAC 34592 15:41:14.728873 tst mo_mt_call.py: using RAC 167 15:41:14.853633 tst mo_mt_call.py: using CellId 34592 15:41:14.976701 tst mo_mt_call.py: using BVCI 34593 15:41:15.103160 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:15.114854 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:15.126302 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:15.137754 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:15.149806 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:15.161837 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:41:15.281444 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:41:15.403883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:15.948574 run create_hlr_db(pid=1312): Launched 15:41:16.107395 bus /sierra_2: Setting Powered False 15:41:17.170205 run create_hlr_db(pid=1312): Terminated: ok {rc=0} 15:41:17.635114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1314): Launched 15:41:17.974463 run osmo-hlr_10.42.42.2(pid=1315): Launched 15:41:18.104209 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:18.683384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1317): Launched 15:41:19.021870 run osmo-stp_10.42.42.5(pid=1318): Launched 15:41:19.149314 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:19.757760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1320): Launched 15:41:20.096518 run osmo-msc_10.42.42.6(pid=1321): Launched 15:41:20.285320 run osmo-stp_10.42.42.5(pid=1318): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1318)] 15:41:20.425990 run osmo-stp_10.42.42.5(pid=1318): stdout: | (launched: 2022-12-13_15:41:18.959153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:20.567468 run osmo-stp_10.42.42.5(pid=1318): stderr: | [0;m[38;5;43m20221213154119154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154119155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154119155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154119155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154119157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154119158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154119158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:20.707425 run osmo-stp_10.42.42.5(pid=1318): stdout: | (launched: 2022-12-13_15:41:18.959153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:20.840485 run osmo-stp_10.42.42.5(pid=1318): stderr: | [0;m[38;5;43m20221213154119154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154119155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154119155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154119155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154119157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154119158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154119158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:20.999875 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1318): Process ended prematurely: osmo-stp_10.42.42.5(pid=1318) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1318)] [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:41:21.009583 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:41:21.037610 run osmo-hlr_10.42.42.2(pid=1315): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1315)] 15:41:21.088455 run osmo-hlr_10.42.42.2(pid=1315): stdout: | (launched: 2022-12-13_15:41:17.911844) 15:41:21.140594 run osmo-hlr_10.42.42.2(pid=1315): stderr: | [0;m[1;31m20221213154118114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154118114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154118114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154118114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154118114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154118114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154118126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154118135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154118135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154118136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:21.213100 run osmo-msc_10.42.42.6(pid=1321): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1321)] 15:41:21.263485 run osmo-msc_10.42.42.6(pid=1321): stdout: | (launched: 2022-12-13_15:41:20.033803) 15:41:21.315407 run osmo-msc_10.42.42.6(pid=1321): stderr: | [0;m[38;5;43m20221213154120362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154120362 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe8f422ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154120362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154120363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154120363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154120363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154120365 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154120365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154120365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154120365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:21.367797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1314): Terminating (SIGTERM) 15:41:21.409993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1317): Terminating (SIGTERM) 15:41:21.452647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1320): Terminating (SIGTERM) 15:41:21.495478 --- ParallelTerminationStrategy: PID 1314 died... 15:41:21.515556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1314): Terminated: ok {rc=0} 15:41:21.561793 --- ParallelTerminationStrategy: PID 1317 died... 15:41:21.581557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1317): Terminated: ok {rc=0} 15:41:21.627662 --- ParallelTerminationStrategy: PID 1320 died... 15:41:21.647345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1320): Terminated: ok {rc=0} 15:41:21.735705 bus /sierra_3: Setting Powered False 15:41:22.834207 bus /sierra_3: Setting Powered False 15:41:23.950632 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:41:25.100243 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:25.112587 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:41:25.172778 tst mo_mt_call_osmux.py: using LAC 34593 15:41:25.305149 tst mo_mt_call_osmux.py: using RAC 168 15:41:25.435872 tst mo_mt_call_osmux.py: using CellId 34593 15:41:25.562323 tst mo_mt_call_osmux.py: using BVCI 34594 15:41:25.679142 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:25.690506 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:25.701738 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:25.712756 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:25.724255 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:25.735521 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:41:25.857959 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:41:25.980511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:26.504474 run create_hlr_db(pid=1323): Launched 15:41:26.641426 bus /sierra_2: Setting Powered False 15:41:27.707315 run create_hlr_db(pid=1323): Terminated: ok {rc=0} 15:41:28.156817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1325): Launched 15:41:28.476137 run osmo-hlr_10.42.42.2(pid=1326): Launched 15:41:28.599048 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:29.157797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1328): Launched 15:41:29.479624 run osmo-stp_10.42.42.5(pid=1329): Launched 15:41:29.604583 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:30.173074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1331): Launched 15:41:30.490174 run osmo-msc_10.42.42.6(pid=1332): Launched 15:41:30.667776 run osmo-stp_10.42.42.5(pid=1329): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1329)] 15:41:30.800243 run osmo-stp_10.42.42.5(pid=1329): stdout: | (launched: 2022-12-13_15:41:29.420525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:30.952244 run osmo-stp_10.42.42.5(pid=1329): stderr: | [0;m[38;5;43m20221213154129594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154129594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154129594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154129595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154129595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154129595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154129595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:31.087011 run osmo-stp_10.42.42.5(pid=1329): stdout: | (launched: 2022-12-13_15:41:29.420525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:31.215090 run osmo-stp_10.42.42.5(pid=1329): stderr: | [0;m[38;5;43m20221213154129594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154129594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154129594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154129595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154129595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154129595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154129595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:31.368324 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1329): Process ended prematurely: osmo-stp_10.42.42.5(pid=1329) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1329)] [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:41:31.378413 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:41:31.405912 run osmo-hlr_10.42.42.2(pid=1326): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1326)] 15:41:31.458492 run osmo-hlr_10.42.42.2(pid=1326): stdout: | (launched: 2022-12-13_15:41:28.416725) 15:41:31.510384 run osmo-hlr_10.42.42.2(pid=1326): stderr: | [0;m[1;31m20221213154128594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154128594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154128594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154128594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154128594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154128594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154128606 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154128614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154128615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154128615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:31.583207 run osmo-msc_10.42.42.6(pid=1332): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1332)] 15:41:31.632452 run osmo-msc_10.42.42.6(pid=1332): stdout: | (launched: 2022-12-13_15:41:30.431039) 15:41:31.685571 run osmo-msc_10.42.42.6(pid=1332): stderr: | [0;m[38;5;43m20221213154130706 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154130706 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f00ad88ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154130706 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154130706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154130706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154130706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154130708 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154130708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154130708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154130709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:31.738175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1325): Terminating (SIGTERM) 15:41:31.779552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1328): Terminating (SIGTERM) 15:41:31.822257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1331): Terminating (SIGTERM) 15:41:31.866686 --- ParallelTerminationStrategy: PID 1325 died... 15:41:31.887834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1325): Terminated: ok {rc=0} 15:41:31.935382 --- ParallelTerminationStrategy: PID 1328 died... 15:41:31.956203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1328): Terminated: ok {rc=0} 15:41:32.002636 --- ParallelTerminationStrategy: PID 1331 died... 15:41:32.023521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1331): Terminated: ok {rc=0} 15:41:32.111522 bus /sierra_3: Setting Powered False 15:41:33.208194 bus /sierra_3: Setting Powered False 15:41:34.325707 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:41:35.559914 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:35.566526 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:41:35.587290 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:41:35.614695 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:41:35.667425 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:41:35.688505 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:41:35.715414 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:41:36.265735 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:41:36.316771 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:36.328258 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:41:36.385650 tst mo_mt_call.py: using LAC 34594 15:41:36.518302 tst mo_mt_call.py: using RAC 169 15:41:36.652218 tst mo_mt_call.py: using CellId 34594 15:41:36.777324 tst mo_mt_call.py: using BVCI 34595 15:41:36.893861 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:36.905252 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:36.916290 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:36.927266 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:36.938744 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:36.950046 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:41:37.071946 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:41:37.192576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:37.682313 run create_hlr_db(pid=1337): Launched 15:41:37.805192 bus /sierra_2: Setting Powered False 15:41:38.867392 run create_hlr_db(pid=1337): Terminated: ok {rc=0} 15:41:39.306674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1339): Launched 15:41:39.624188 run osmo-hlr_10.42.42.2(pid=1340): Launched 15:41:39.746493 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:40.307001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1342): Launched 15:41:40.625681 run osmo-stp_10.42.42.5(pid=1343): Launched 15:41:40.747352 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:41.317699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1345): Launched 15:41:41.634543 run osmo-msc_10.42.42.6(pid=1346): Launched 15:41:41.812742 run osmo-stp_10.42.42.5(pid=1343): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1343)] 15:41:41.946344 run osmo-stp_10.42.42.5(pid=1343): stdout: | (launched: 2022-12-13_15:41:40.566190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:42.079702 run osmo-stp_10.42.42.5(pid=1343): stderr: | [0;m[38;5;43m20221213154140742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154140742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154140743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154140743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154140743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154140744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154140744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:42.211687 run osmo-stp_10.42.42.5(pid=1343): stdout: | (launched: 2022-12-13_15:41:40.566190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:42.336775 run osmo-stp_10.42.42.5(pid=1343): stderr: | [0;m[38;5;43m20221213154140742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154140742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154140743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154140743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154140743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154140744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154140744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:42.487353 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1343): Process ended prematurely: osmo-stp_10.42.42.5(pid=1343) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1343)] [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:41:42.496623 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:41:42.523589 run osmo-hlr_10.42.42.2(pid=1340): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1340)] 15:41:42.573601 run osmo-hlr_10.42.42.2(pid=1340): stdout: | (launched: 2022-12-13_15:41:39.564659) 15:41:42.624476 run osmo-hlr_10.42.42.2(pid=1340): stderr: | [0;m[1;31m20221213154139746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154139746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154139746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154139746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154139746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154139747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154139759 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154139767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154139767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154139767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:42.695620 run osmo-msc_10.42.42.6(pid=1346): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1346)] 15:41:42.744365 run osmo-msc_10.42.42.6(pid=1346): stdout: | (launched: 2022-12-13_15:41:41.575047) 15:41:42.795285 run osmo-msc_10.42.42.6(pid=1346): stderr: | [0;m[38;5;43m20221213154141851 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154141851 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f76ebf1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154141851 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154141851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154141851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154141851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154141853 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154141854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154141854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154141854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:42.846926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1339): Terminating (SIGTERM) 15:41:42.887418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1342): Terminating (SIGTERM) 15:41:42.928314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1345): Terminating (SIGTERM) 15:41:42.969602 --- ParallelTerminationStrategy: PID 1339 died... 15:41:42.989565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1339): Terminated: ok {rc=0} 15:41:43.034709 --- ParallelTerminationStrategy: PID 1342 died... 15:41:43.054029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1342): Terminated: ok {rc=0} 15:41:43.098737 --- ParallelTerminationStrategy: PID 1345 died... 15:41:43.118117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1345): Terminated: ok {rc=0} 15:41:43.203501 bus /sierra_3: Setting Powered False 15:41:44.301925 bus /sierra_3: Setting Powered False 15:41:45.419787 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:41:46.575773 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:46.589470 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:41:46.648942 tst mo_mt_call_osmux.py: using LAC 34595 15:41:46.785547 tst mo_mt_call_osmux.py: using RAC 170 15:41:46.940225 tst mo_mt_call_osmux.py: using CellId 34595 15:41:47.073766 tst mo_mt_call_osmux.py: using BVCI 34596 15:41:47.198992 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:47.211211 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:47.223252 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:47.235309 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:47.247273 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:47.260836 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:41:47.384547 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:41:47.506884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:48.032515 run create_hlr_db(pid=1348): Launched 15:41:48.170882 bus /sierra_2: Setting Powered False 15:41:49.236785 run create_hlr_db(pid=1348): Terminated: ok {rc=0} 15:41:49.687002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1350): Launched 15:41:50.005567 run osmo-hlr_10.42.42.2(pid=1351): Launched 15:41:50.125737 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:50.683302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1353): Launched 15:41:51.000843 run osmo-stp_10.42.42.5(pid=1354): Launched 15:41:51.123187 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:51.692083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1356): Launched 15:41:52.010860 run osmo-msc_10.42.42.6(pid=1357): Launched 15:41:52.188858 run osmo-stp_10.42.42.5(pid=1354): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1354)] 15:41:52.322626 run osmo-stp_10.42.42.5(pid=1354): stdout: | (launched: 2022-12-13_15:41:50.941669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:52.456890 run osmo-stp_10.42.42.5(pid=1354): stderr: | [0;m[38;5;43m20221213154151115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154151115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154151116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154151116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154151117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154151117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154151117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:52.588734 run osmo-stp_10.42.42.5(pid=1354): stdout: | (launched: 2022-12-13_15:41:50.941669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:52.714307 run osmo-stp_10.42.42.5(pid=1354): stderr: | [0;m[38;5;43m20221213154151115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154151115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154151116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154151116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154151117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154151117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154151117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:52.864452 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1354): Process ended prematurely: osmo-stp_10.42.42.5(pid=1354) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1354)] [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:41:52.873871 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:41:52.900615 run osmo-hlr_10.42.42.2(pid=1351): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1351)] 15:41:52.949785 run osmo-hlr_10.42.42.2(pid=1351): stdout: | (launched: 2022-12-13_15:41:49.946748) 15:41:53.000259 run osmo-hlr_10.42.42.2(pid=1351): stderr: | [0;m[1;31m20221213154150124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154150124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154150124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154150124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154150124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154150124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154150137 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154150145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154150145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154150145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:53.070978 run osmo-msc_10.42.42.6(pid=1357): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1357)] 15:41:53.119283 run osmo-msc_10.42.42.6(pid=1357): stdout: | (launched: 2022-12-13_15:41:51.951356) 15:41:53.169911 run osmo-msc_10.42.42.6(pid=1357): stderr: | [0;m[38;5;43m20221213154152226 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154152226 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd124f23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154152226 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154152227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154152227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154152227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154152229 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154152229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154152229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154152229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:53.220567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1350): Terminating (SIGTERM) 15:41:53.261170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1353): Terminating (SIGTERM) 15:41:53.301651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1356): Terminating (SIGTERM) 15:41:53.342914 --- ParallelTerminationStrategy: PID 1350 died... 15:41:53.362645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1350): Terminated: ok {rc=0} 15:41:53.407101 --- ParallelTerminationStrategy: PID 1353 died... 15:41:53.426323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1353): Terminated: ok {rc=0} 15:41:53.470772 --- ParallelTerminationStrategy: PID 1356 died... 15:41:53.489906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1356): Terminated: ok {rc=0} 15:41:53.574342 bus /sierra_3: Setting Powered False 15:41:54.673886 bus /sierra_3: Setting Powered False 15:41:55.794617 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:41:57.047065 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:57.054058 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:41:57.075471 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:41:57.103362 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:41:57.156452 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:41:57.177473 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:41:57.205033 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:41:57.757579 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:41:57.811410 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:57.823123 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:41:57.880564 tst mo_mt_call.py: using LAC 34596 15:41:58.003835 tst mo_mt_call.py: using RAC 171 15:41:58.132485 tst mo_mt_call.py: using CellId 34596 15:41:58.255123 tst mo_mt_call.py: using BVCI 34597 15:41:58.371197 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:58.382688 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:58.393841 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:58.404741 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:58.416088 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:58.427496 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:41:58.551424 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:41:58.672121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:59.195859 run create_hlr_db(pid=1362): Launched 15:41:59.331838 bus /sierra_2: Setting Powered False 15:42:00.397093 run create_hlr_db(pid=1362): Terminated: ok {rc=0} 15:42:00.897430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1364): Launched 15:42:01.405829 run osmo-hlr_10.42.42.2(pid=1369): Launched 15:42:01.715233 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:02.476056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1371): Launched 15:42:02.804873 run osmo-stp_10.42.42.5(pid=1372): Launched 15:42:02.927775 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:03.518570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1374): Launched 15:42:03.837570 run osmo-msc_10.42.42.6(pid=1375): Launched 15:42:04.015922 run osmo-stp_10.42.42.5(pid=1372): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1372)] 15:42:04.149263 run osmo-stp_10.42.42.5(pid=1372): stdout: | (launched: 2022-12-13_15:42:02.745846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:04.281847 run osmo-stp_10.42.42.5(pid=1372): stderr: | [0;m[38;5;43m20221213154202919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154202919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154202919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154202920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154202920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154202920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154202920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:04.413403 run osmo-stp_10.42.42.5(pid=1372): stdout: | (launched: 2022-12-13_15:42:02.745846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:04.538728 run osmo-stp_10.42.42.5(pid=1372): stderr: | [0;m[38;5;43m20221213154202919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154202919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154202919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154202920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154202920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154202920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154202920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:04.688115 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1372): Process ended prematurely: osmo-stp_10.42.42.5(pid=1372) [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1372)] [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:42:04.697140 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 15:42:04.723687 run osmo-hlr_10.42.42.2(pid=1369): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1369)] 15:42:04.772582 run osmo-hlr_10.42.42.2(pid=1369): stdout: | (launched: 2022-12-13_15:42:01.283264) 15:42:04.822665 run osmo-hlr_10.42.42.2(pid=1369): stderr: | [0;m[1;31m20221213154201717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154201717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154201717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154201717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154201717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154201719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154201770 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154201779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154201779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154201779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:04.892677 run osmo-msc_10.42.42.6(pid=1375): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1375)] 15:42:04.940688 run osmo-msc_10.42.42.6(pid=1375): stdout: | (launched: 2022-12-13_15:42:03.778064) 15:42:04.990756 run osmo-msc_10.42.42.6(pid=1375): stderr: | [0;m[38;5;43m20221213154204055 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154204055 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2fbfb22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154204056 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154204056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154204056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154204056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154204058 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154204058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154204058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154204058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:05.041094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1364): Terminating (SIGTERM) 15:42:05.081460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1371): Terminating (SIGTERM) 15:42:05.122197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1374): Terminating (SIGTERM) 15:42:05.163246 --- ParallelTerminationStrategy: PID 1364 died... 15:42:05.182714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1364): Terminated: ok {rc=0} 15:42:05.227068 --- ParallelTerminationStrategy: PID 1371 died... 15:42:05.246153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1371): Terminated: ok {rc=0} 15:42:05.291048 --- ParallelTerminationStrategy: PID 1374 died... 15:42:05.310275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1374): Terminated: ok {rc=0} 15:42:05.396447 bus /sierra_3: Setting Powered False 15:42:06.495909 bus /sierra_3: Setting Powered False 15:42:07.616266 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:42:08.771294 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:08.783554 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:42:08.845417 tst mo_mt_call_osmux.py: using LAC 34597 15:42:08.976548 tst mo_mt_call_osmux.py: using RAC 172 15:42:09.107024 tst mo_mt_call_osmux.py: using CellId 34597 15:42:09.237072 tst mo_mt_call_osmux.py: using BVCI 34598 15:42:09.359581 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:09.371197 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:09.382655 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:09.394107 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:09.405604 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:09.417177 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:42:09.535321 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:42:09.658280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:10.181095 run create_hlr_db(pid=1377): Launched 15:42:10.318970 bus /sierra_2: Setting Powered False 15:42:11.384643 run create_hlr_db(pid=1377): Terminated: ok {rc=0} 15:42:11.854535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1379): Launched 15:42:12.192915 run osmo-hlr_10.42.42.2(pid=1380): Launched 15:42:12.322403 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:12.904271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1382): Launched 15:42:13.243706 run osmo-stp_10.42.42.5(pid=1383): Launched 15:42:13.373381 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:13.983399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1385): Launched 15:42:14.320854 run osmo-msc_10.42.42.6(pid=1386): Launched 15:42:14.509118 run osmo-stp_10.42.42.5(pid=1383): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1383)] 15:42:14.650417 run osmo-stp_10.42.42.5(pid=1383): stdout: | (launched: 2022-12-13_15:42:13.180823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:14.792671 run osmo-stp_10.42.42.5(pid=1383): stderr: | [0;m[38;5;43m20221213154213377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154213377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154213377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154213378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154213380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154213380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154213380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:14.932653 run osmo-stp_10.42.42.5(pid=1383): stdout: | (launched: 2022-12-13_15:42:13.180823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:15.065759 run osmo-stp_10.42.42.5(pid=1383): stderr: | [0;m[38;5;43m20221213154213377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154213377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154213377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154213378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154213380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154213380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154213380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:15.225249 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1383): Process ended prematurely: osmo-stp_10.42.42.5(pid=1383) [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1383)] [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:42:15.235097 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:42:15.263064 run osmo-hlr_10.42.42.2(pid=1380): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1380)] 15:42:15.313901 run osmo-hlr_10.42.42.2(pid=1380): stdout: | (launched: 2022-12-13_15:42:12.130449) 15:42:15.366896 run osmo-hlr_10.42.42.2(pid=1380): stderr: | [0;m[1;31m20221213154212332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154212332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154212332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154212332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154212332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154212332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154212384 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154212394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154212394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154212394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:15.439556 run osmo-msc_10.42.42.6(pid=1386): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1386)] 15:42:15.490012 run osmo-msc_10.42.42.6(pid=1386): stdout: | (launched: 2022-12-13_15:42:14.258449) 15:42:15.542280 run osmo-msc_10.42.42.6(pid=1386): stderr: | [0;m[38;5;43m20221213154214585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154214586 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1536a0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154214586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154214586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154214586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154214586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154214588 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154214588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154214588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154214588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:15.594709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1379): Terminating (SIGTERM) 15:42:15.637246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1382): Terminating (SIGTERM) 15:42:15.679505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1385): Terminating (SIGTERM) 15:42:15.721729 --- ParallelTerminationStrategy: PID 1379 died... 15:42:15.741886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1379): Terminated: ok {rc=0} 15:42:15.789153 --- ParallelTerminationStrategy: PID 1382 died... 15:42:15.808847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1382): Terminated: ok {rc=0} 15:42:15.864500 --- ParallelTerminationStrategy: PID 1385 died... 15:42:15.889142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1385): Terminated: ok {rc=0} 15:42:15.979196 bus /sierra_3: Setting Powered False 15:42:17.090914 bus /sierra_3: Setting Powered False 15:42:18.210380 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:42:19.446664 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:42:19.453047 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:42:19.474796 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:42:19.502174 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:42:19.555729 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:42:19.577177 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:42:19.603941 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:42:20.153166 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:42:20.205519 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:20.216829 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:42:20.278001 tst mo_mt_call.py: using LAC 34598 15:42:20.401648 tst mo_mt_call.py: using RAC 173 15:42:20.533360 tst mo_mt_call.py: using CellId 34598 15:42:20.663682 tst mo_mt_call.py: using BVCI 34599 15:42:20.786805 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:20.798551 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:20.810027 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:20.821541 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:20.833218 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:20.844718 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:42:20.967866 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:42:21.087029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:21.579399 run create_hlr_db(pid=1391): Launched 15:42:21.702661 bus /sierra_2: Setting Powered False 15:42:22.764911 run create_hlr_db(pid=1391): Terminated: ok {rc=0} 15:42:23.227329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1393): Launched 15:42:23.567270 run osmo-hlr_10.42.42.2(pid=1394): Launched 15:42:23.697836 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:24.280928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1396): Launched 15:42:24.621463 run osmo-stp_10.42.42.5(pid=1397): Launched 15:42:24.752621 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:25.363512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1399): Launched 15:42:25.703247 run osmo-msc_10.42.42.6(pid=1400): Launched 15:42:25.893129 run osmo-stp_10.42.42.5(pid=1397): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1397)] 15:42:26.035258 run osmo-stp_10.42.42.5(pid=1397): stdout: | (launched: 2022-12-13_15:42:24.558506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:26.177871 run osmo-stp_10.42.42.5(pid=1397): stderr: | [0;m[38;5;43m20221213154224756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154224756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154224756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154224757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154224757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154224757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154224757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:26.318119 run osmo-stp_10.42.42.5(pid=1397): stdout: | (launched: 2022-12-13_15:42:24.558506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:26.451665 run osmo-stp_10.42.42.5(pid=1397): stderr: | [0;m[38;5;43m20221213154224756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154224756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154224756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154224757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154224757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154224757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154224757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:26.611982 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1397): Process ended prematurely: osmo-stp_10.42.42.5(pid=1397) [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1397)] [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:42:26.621846 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:42:26.650104 run osmo-hlr_10.42.42.2(pid=1394): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1394)] 15:42:26.701648 run osmo-hlr_10.42.42.2(pid=1394): stdout: | (launched: 2022-12-13_15:42:23.504337) 15:42:26.754776 run osmo-hlr_10.42.42.2(pid=1394): stderr: | [0;m[1;31m20221213154223707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154223707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154223707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154223707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154223707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154223707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154223723 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154223733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154223733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154223733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:26.828432 run osmo-msc_10.42.42.6(pid=1400): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1400)] 15:42:26.879281 run osmo-msc_10.42.42.6(pid=1400): stdout: | (launched: 2022-12-13_15:42:25.640023) 15:42:26.931972 run osmo-msc_10.42.42.6(pid=1400): stderr: | [0;m[38;5;43m20221213154225967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154225968 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f427e69dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154225968 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154225968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154225968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154225968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154225970 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154225970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154225970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154225970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:26.984875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1393): Terminating (SIGTERM) 15:42:27.027801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1396): Terminating (SIGTERM) 15:42:27.070713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1399): Terminating (SIGTERM) 15:42:27.113808 --- ParallelTerminationStrategy: PID 1393 died... 15:42:27.134152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1393): Terminated: ok {rc=0} 15:42:27.181366 --- ParallelTerminationStrategy: PID 1396 died... 15:42:27.201282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1396): Terminated: ok {rc=0} 15:42:27.248064 --- ParallelTerminationStrategy: PID 1399 died... 15:42:27.268097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1399): Terminated: ok {rc=0} 15:42:27.358672 bus /sierra_3: Setting Powered False 15:42:28.459296 bus /sierra_3: Setting Powered False 15:42:29.580105 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:42:30.733469 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:30.746074 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:42:30.805543 tst mo_mt_call_osmux.py: using LAC 34599 15:42:30.964451 tst mo_mt_call_osmux.py: using RAC 174 15:42:31.125414 tst mo_mt_call_osmux.py: using CellId 34599 15:42:31.259619 tst mo_mt_call_osmux.py: using BVCI 34600 15:42:31.384238 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:31.396407 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:31.408493 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:31.420524 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:31.432490 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:31.444528 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:42:31.565520 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:42:31.693824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:32.224706 run create_hlr_db(pid=1402): Launched 15:42:32.379269 bus /sierra_2: Setting Powered False 15:42:33.441197 run create_hlr_db(pid=1402): Terminated: ok {rc=0} 15:42:33.901180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1404): Launched 15:42:34.239591 run osmo-hlr_10.42.42.2(pid=1405): Launched 15:42:34.368507 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:34.949426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1407): Launched 15:42:35.287475 run osmo-stp_10.42.42.5(pid=1408): Launched 15:42:35.416362 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:36.026075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1410): Launched 15:42:36.365062 run osmo-msc_10.42.42.6(pid=1411): Launched 15:42:36.552690 run osmo-stp_10.42.42.5(pid=1408): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1408)] 15:42:36.693888 run osmo-stp_10.42.42.5(pid=1408): stdout: | (launched: 2022-12-13_15:42:35.224733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:36.836822 run osmo-stp_10.42.42.5(pid=1408): stderr: | [0;m[38;5;43m20221213154235419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154235419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154235419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154235420 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154235422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154235422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154235422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:36.977180 run osmo-stp_10.42.42.5(pid=1408): stdout: | (launched: 2022-12-13_15:42:35.224733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:37.110141 run osmo-stp_10.42.42.5(pid=1408): stderr: | [0;m[38;5;43m20221213154235419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154235419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154235419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154235420 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154235422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154235422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154235422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:37.269710 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1408): Process ended prematurely: osmo-stp_10.42.42.5(pid=1408) [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1408)] [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:42:37.279315 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 15:42:37.307068 run osmo-hlr_10.42.42.2(pid=1405): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1405)] 15:42:37.357195 run osmo-hlr_10.42.42.2(pid=1405): stdout: | (launched: 2022-12-13_15:42:34.177102) 15:42:37.409310 run osmo-hlr_10.42.42.2(pid=1405): stderr: | [0;m[1;31m20221213154234379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154234379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154234379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154234379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154234379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154234379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154234391 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154234400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154234400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154234400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:37.481581 run osmo-msc_10.42.42.6(pid=1411): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1411)] 15:42:37.531855 run osmo-msc_10.42.42.6(pid=1411): stdout: | (launched: 2022-12-13_15:42:36.302463) 15:42:37.583586 run osmo-msc_10.42.42.6(pid=1411): stderr: | [0;m[38;5;43m20221213154236628 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154236628 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff43a67cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154236628 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154236628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154236628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154236628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154236630 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154236631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154236631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154236631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:37.635551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1404): Terminating (SIGTERM) 15:42:37.677423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1407): Terminating (SIGTERM) 15:42:37.719901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1410): Terminating (SIGTERM) 15:42:37.762068 --- ParallelTerminationStrategy: PID 1404 died... 15:42:37.782461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1404): Terminated: ok {rc=0} 15:42:37.828860 --- ParallelTerminationStrategy: PID 1407 died... 15:42:37.848463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1407): Terminated: ok {rc=0} 15:42:37.894988 --- ParallelTerminationStrategy: PID 1410 died... 15:42:37.914539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1410): Terminated: ok {rc=0} 15:42:38.002768 bus /sierra_3: Setting Powered False 15:42:39.102326 bus /sierra_3: Setting Powered False 15:42:40.219287 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:42:41.458397 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:42:41.465550 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:42:41.486669 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:42:41.514419 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:42:41.567951 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:42:41.589525 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:42:41.617093 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:42:42.169165 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:42:42.223799 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:42.235680 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:42:42.295155 tst mo_mt_call.py: using LAC 34600 15:42:42.428340 tst mo_mt_call.py: using RAC 175 15:42:42.559653 tst mo_mt_call.py: using CellId 34600 15:42:42.692336 tst mo_mt_call.py: using BVCI 34601 15:42:42.815861 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:42.827681 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:42.839375 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:42.851129 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:42.862675 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:42.874292 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:42:42.993914 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:42:43.117246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:43.642682 run create_hlr_db(pid=1416): Launched 15:42:43.782004 bus /sierra_2: Setting Powered False 15:42:44.848753 run create_hlr_db(pid=1416): Terminated: ok {rc=0} 15:42:45.300686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1418): Launched 15:42:45.619966 run osmo-hlr_10.42.42.2(pid=1419): Launched 15:42:45.743284 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:46.373184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1421): Launched 15:42:46.723991 run osmo-stp_10.42.42.5(pid=1422): Launched 15:42:47.002124 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:47.729819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1424): Launched 15:42:48.070381 run osmo-msc_10.42.42.6(pid=1425): Launched 15:42:48.259238 run osmo-stp_10.42.42.5(pid=1422): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1422)] 15:42:48.399942 run osmo-stp_10.42.42.5(pid=1422): stdout: | (launched: 2022-12-13_15:42:46.657899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:48.540631 run osmo-stp_10.42.42.5(pid=1422): stderr: | [0;m[38;5;43m20221213154247057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154247060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154247061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154247061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154247062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154247062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154247062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:48.680706 run osmo-stp_10.42.42.5(pid=1422): stdout: | (launched: 2022-12-13_15:42:46.657899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:48.814422 run osmo-stp_10.42.42.5(pid=1422): stderr: | [0;m[38;5;43m20221213154247057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154247060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154247061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154247061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154247062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154247062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154247062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:48.974695 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1422): Process ended prematurely: osmo-stp_10.42.42.5(pid=1422) [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1422)] [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:42:48.984295 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 15:42:49.012147 run osmo-hlr_10.42.42.2(pid=1419): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1419)] 15:42:49.062957 run osmo-hlr_10.42.42.2(pid=1419): stdout: | (launched: 2022-12-13_15:42:45.560395) 15:42:49.115681 run osmo-hlr_10.42.42.2(pid=1419): stderr: | [0;m[1;31m20221213154245742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154245743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154245743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154245743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154245743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154245743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154245755 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154245765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154245765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154245766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:49.188634 run osmo-msc_10.42.42.6(pid=1425): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1425)] 15:42:49.239311 run osmo-msc_10.42.42.6(pid=1425): stdout: | (launched: 2022-12-13_15:42:48.007122) 15:42:49.291431 run osmo-msc_10.42.42.6(pid=1425): stderr: | [0;m[38;5;43m20221213154248334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154248334 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc029692c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154248334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154248334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154248334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154248334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154248336 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154248336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154248337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154248337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:49.344244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1418): Terminating (SIGTERM) 15:42:49.386770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1421): Terminating (SIGTERM) 15:42:49.429050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1424): Terminating (SIGTERM) 15:42:49.471440 --- ParallelTerminationStrategy: PID 1418 died... 15:42:49.491701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1418): Terminated: ok {rc=0} 15:42:49.538357 --- ParallelTerminationStrategy: PID 1421 died... 15:42:49.558090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1421): Terminated: ok {rc=0} 15:42:49.605097 --- ParallelTerminationStrategy: PID 1424 died... 15:42:49.624850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1424): Terminated: ok {rc=0} 15:42:49.713805 bus /sierra_3: Setting Powered False 15:42:50.815447 bus /sierra_3: Setting Powered False 15:42:51.933937 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:42:53.087085 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:53.099501 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:42:53.159562 tst mo_mt_call_osmux.py: using LAC 34601 15:42:53.291246 tst mo_mt_call_osmux.py: using RAC 176 15:42:53.425032 tst mo_mt_call_osmux.py: using CellId 34601 15:42:53.556724 tst mo_mt_call_osmux.py: using BVCI 34602 15:42:53.679511 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:53.691195 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:53.702899 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:53.714494 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:53.726134 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:53.737837 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:42:53.857746 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:42:53.981405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:54.505946 run create_hlr_db(pid=1427): Launched 15:42:54.644090 bus /sierra_2: Setting Powered False 15:42:55.710703 run create_hlr_db(pid=1427): Terminated: ok {rc=0} 15:42:56.162496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1429): Launched 15:42:56.481899 run osmo-hlr_10.42.42.2(pid=1430): Launched 15:42:56.605273 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:57.163151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1432): Launched 15:42:57.480344 run osmo-stp_10.42.42.5(pid=1433): Launched 15:42:57.602386 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:58.172409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1435): Launched 15:42:58.491167 run osmo-msc_10.42.42.6(pid=1436): Launched 15:42:58.669618 run osmo-stp_10.42.42.5(pid=1433): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1433)] 15:42:58.803649 run osmo-stp_10.42.42.5(pid=1433): stdout: | (launched: 2022-12-13_15:42:57.421256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:58.936526 run osmo-stp_10.42.42.5(pid=1433): stderr: | [0;m[38;5;43m20221213154257592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154257592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154257593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154257593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154257595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154257596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154257596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:59.068245 run osmo-stp_10.42.42.5(pid=1433): stdout: | (launched: 2022-12-13_15:42:57.421256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:59.192857 run osmo-stp_10.42.42.5(pid=1433): stderr: | [0;m[38;5;43m20221213154257592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154257592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154257593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154257593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154257595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154257596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154257596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:59.342542 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1433): Process ended prematurely: osmo-stp_10.42.42.5(pid=1433) [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1433)] [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:42:59.351556 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:42:59.378102 run osmo-hlr_10.42.42.2(pid=1430): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1430)] 15:42:59.426723 run osmo-hlr_10.42.42.2(pid=1430): stdout: | (launched: 2022-12-13_15:42:56.422574) 15:42:59.476669 run osmo-hlr_10.42.42.2(pid=1430): stderr: | [0;m[1;31m20221213154256601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154256601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154256601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154256601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154256601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154256601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154256613 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154256621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154256621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154256621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:59.546829 run osmo-msc_10.42.42.6(pid=1436): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1436)] 15:42:59.594941 run osmo-msc_10.42.42.6(pid=1436): stdout: | (launched: 2022-12-13_15:42:58.431500) 15:42:59.644900 run osmo-msc_10.42.42.6(pid=1436): stderr: | [0;m[38;5;43m20221213154258708 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154258708 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb7cdc84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154258708 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154258708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154258708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154258709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154258710 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154258711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154258711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154258711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:59.695471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1429): Terminating (SIGTERM) 15:42:59.735571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1432): Terminating (SIGTERM) 15:42:59.775887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1435): Terminating (SIGTERM) 15:42:59.816177 --- ParallelTerminationStrategy: PID 1429 died... 15:42:59.835839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1429): Terminated: ok {rc=0} 15:42:59.880316 --- ParallelTerminationStrategy: PID 1432 died... 15:42:59.899352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1432): Terminated: ok {rc=0} 15:42:59.943458 --- ParallelTerminationStrategy: PID 1435 died... 15:42:59.962589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1435): Terminated: ok {rc=0} 15:43:00.049087 bus /sierra_3: Setting Powered False 15:43:01.149196 bus /sierra_3: Setting Powered False 15:43:02.269289 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:43:03.504213 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:43:03.510248 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:43:03.531045 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:43:03.558474 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:43:03.611906 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:43:03.633837 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:43:03.661124 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:43:04.208170 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:43:04.258982 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:04.269972 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:43:04.327662 tst mo_mt_call.py: using LAC 34602 15:43:04.452140 tst mo_mt_call.py: using RAC 177 15:43:04.576813 tst mo_mt_call.py: using CellId 34602 15:43:04.701984 tst mo_mt_call.py: using BVCI 34603 15:43:04.818211 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:04.829317 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:04.840054 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:04.850813 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:04.862002 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:04.873049 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:43:04.993526 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:43:05.121371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:05.611013 run create_hlr_db(pid=1441): Launched 15:43:05.732508 bus /sierra_2: Setting Powered False 15:43:06.795107 run create_hlr_db(pid=1441): Terminated: ok {rc=0} 15:43:07.236030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1443): Launched 15:43:07.552502 run osmo-hlr_10.42.42.2(pid=1444): Launched 15:43:07.676059 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:08.235575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1446): Launched 15:43:08.556348 run osmo-stp_10.42.42.5(pid=1447): Launched 15:43:08.679345 run osmo-msc_10.42.42.6: Starting osmo-msc 15:43:09.253435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1449): Launched 15:43:09.571696 run osmo-msc_10.42.42.6(pid=1450): Launched 15:43:09.752144 run osmo-stp_10.42.42.5(pid=1447): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1447)] 15:43:09.887843 run osmo-stp_10.42.42.5(pid=1447): stdout: | (launched: 2022-12-13_15:43:08.496708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:10.021410 run osmo-stp_10.42.42.5(pid=1447): stderr: | [0;m[38;5;43m20221213154308670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154308670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154308670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154308671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154308671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154308671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154308671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:10.153609 run osmo-stp_10.42.42.5(pid=1447): stdout: | (launched: 2022-12-13_15:43:08.496708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:10.279656 run osmo-stp_10.42.42.5(pid=1447): stderr: | [0;m[38;5;43m20221213154308670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154308670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154308670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154308671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154308671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154308671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154308671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:10.430166 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1447): Process ended prematurely: osmo-stp_10.42.42.5(pid=1447) [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1447)] [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:43:10.439213 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:43:10.466040 run osmo-hlr_10.42.42.2(pid=1444): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1444)] 15:43:10.515371 run osmo-hlr_10.42.42.2(pid=1444): stdout: | (launched: 2022-12-13_15:43:07.493492) 15:43:10.566168 run osmo-hlr_10.42.42.2(pid=1444): stderr: | [0;m[1;31m20221213154307672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154307672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154307672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154307672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154307672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154307672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154307685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154307693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154307693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154307693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:10.637068 run osmo-msc_10.42.42.6(pid=1450): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1450)] 15:43:10.685769 run osmo-msc_10.42.42.6(pid=1450): stdout: | (launched: 2022-12-13_15:43:09.512160) 15:43:10.736370 run osmo-msc_10.42.42.6(pid=1450): stderr: | [0;m[38;5;43m20221213154309787 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154309788 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f15f31bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154309788 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154309788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154309788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154309788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154309790 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154309790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154309790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154309791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:43:10.787390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1443): Terminating (SIGTERM) 15:43:10.828515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1446): Terminating (SIGTERM) 15:43:10.869474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1449): Terminating (SIGTERM) 15:43:10.910563 --- ParallelTerminationStrategy: PID 1443 died... 15:43:10.930249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1443): Terminated: ok {rc=0} 15:43:10.975313 --- ParallelTerminationStrategy: PID 1446 died... 15:43:10.994435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1446): Terminated: ok {rc=0} 15:43:11.039275 --- ParallelTerminationStrategy: PID 1449 died... 15:43:11.058858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1449): Terminated: ok {rc=0} 15:43:11.147288 bus /sierra_3: Setting Powered False 15:43:12.250871 bus /sierra_3: Setting Powered False 15:43:13.371541 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:43:14.520537 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:14.532323 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:43:14.590744 tst mo_mt_call_osmux.py: using LAC 34603 15:43:14.716221 tst mo_mt_call_osmux.py: using RAC 178 15:43:14.841467 tst mo_mt_call_osmux.py: using CellId 34603 15:43:14.967411 tst mo_mt_call_osmux.py: using BVCI 34604 15:43:15.082598 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:15.093779 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:15.104654 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:15.115462 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:15.126678 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:15.137870 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:43:15.255706 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:43:15.378110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:15.933989 run create_hlr_db(pid=1452): Launched 15:43:16.112196 bus /sierra_2: Setting Powered False 15:43:17.177889 run create_hlr_db(pid=1452): Terminated: ok {rc=0} 15:43:17.642054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1454): Launched 15:43:17.959479 run osmo-hlr_10.42.42.2(pid=1455): Launched 15:43:18.081874 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:18.623324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1457): Launched 15:43:18.942037 run osmo-stp_10.42.42.5(pid=1458): Launched 15:43:19.062137 run osmo-msc_10.42.42.6: Starting osmo-msc 15:43:19.631996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1460): Launched 15:43:19.952614 run osmo-msc_10.42.42.6(pid=1461): Launched 15:43:20.129649 run osmo-stp_10.42.42.5(pid=1458): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1458)] 15:43:20.262803 run osmo-stp_10.42.42.5(pid=1458): stdout: | (launched: 2022-12-13_15:43:18.882672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:20.395860 run osmo-stp_10.42.42.5(pid=1458): stderr: | [0;m[38;5;43m20221213154319056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154319056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154319056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154319057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154319058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154319058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154319058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:20.526901 run osmo-stp_10.42.42.5(pid=1458): stdout: | (launched: 2022-12-13_15:43:18.882672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:20.651610 run osmo-stp_10.42.42.5(pid=1458): stderr: | [0;m[38;5;43m20221213154319056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154319056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154319056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154319057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154319058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154319058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154319058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:20.800927 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1458): Process ended prematurely: osmo-stp_10.42.42.5(pid=1458) [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1458)] [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:43:20.810181 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:43:20.836824 run osmo-hlr_10.42.42.2(pid=1455): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1455)] 15:43:20.885895 run osmo-hlr_10.42.42.2(pid=1455): stdout: | (launched: 2022-12-13_15:43:17.900205) 15:43:20.936170 run osmo-hlr_10.42.42.2(pid=1455): stderr: | [0;m[1;31m20221213154318081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154318081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154318081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154318081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154318081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154318081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154318095 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154318104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154318104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154318104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:21.006622 run osmo-msc_10.42.42.6(pid=1461): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1461)] 15:43:21.054730 run osmo-msc_10.42.42.6(pid=1461): stdout: | (launched: 2022-12-13_15:43:19.893135) 15:43:21.104848 run osmo-msc_10.42.42.6(pid=1461): stderr: | [0;m[38;5;43m20221213154320169 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154320169 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1067115c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154320169 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154320169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154320169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154320169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154320171 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154320171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154320172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154320172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:43:21.155569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1454): Terminating (SIGTERM) 15:43:21.195942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1457): Terminating (SIGTERM) 15:43:21.236101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1460): Terminating (SIGTERM) 15:43:21.276353 --- ParallelTerminationStrategy: PID 1454 died... 15:43:21.295782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1454): Terminated: ok {rc=0} 15:43:21.340015 --- ParallelTerminationStrategy: PID 1457 died... 15:43:21.358918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1457): Terminated: ok {rc=0} 15:43:21.403342 --- ParallelTerminationStrategy: PID 1460 died... 15:43:21.422403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1460): Terminated: ok {rc=0} 15:43:21.510033 bus /sierra_3: Setting Powered False 15:43:22.610608 bus /sierra_3: Setting Powered False 15:43:23.728641 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 emergency:sysmo --------------------------------------------------------------------- 15:43:24.962287 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:43:24.966564 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 15:43:24.987254 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 15:43:25.014517 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 15:43:25.099693 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 15:43:25.120495 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 15:43:25.147117 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 15:43:25.730813 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2391 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 15:43:25.735935 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:25.746664 tst emergency:sysmo: Using 1 x bts (candidates: 1) 15:43:25.782440 tst emergency_mo_mt_call.py: using LAC 34604 15:43:25.911030 tst emergency_mo_mt_call.py: using RAC 179 15:43:26.032084 tst emergency_mo_mt_call.py: using CellId 34604 15:43:26.152528 tst emergency_mo_mt_call.py: using BVCI 34605 15:43:26.265457 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:26.276059 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:26.286712 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:26.297255 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:26.308611 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:26.320057 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:43:26.443636 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:43:26.562692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:27.046393 run create_hlr_db(pid=1466): Launched 15:43:27.165867 bus /sierra_2: Setting Powered False 15:43:28.227745 run create_hlr_db(pid=1466): Terminated: ok {rc=0} 15:43:28.665064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1468): Launched 15:43:28.979229 run osmo-hlr_10.42.42.2(pid=1469): Launched 15:43:29.100557 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:29.652635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1471): Launched 15:43:29.966037 run osmo-stp_10.42.42.5(pid=1472): Launched 15:43:30.099402 tst emergency_mo_mt_call.py: using MSISDN 8210 15:43:30.268663 run osmo-msc_10.42.42.6: Starting osmo-msc 15:43:30.825320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1474): Launched 15:43:31.189058 run osmo-msc_10.42.42.6(pid=1475): Launched 15:43:31.571715 run osmo-stp_10.42.42.5(pid=1472): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1472)] 15:43:31.834977 run osmo-stp_10.42.42.5(pid=1472): stdout: | (launched: 2022-12-13_15:43:29.907298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:32.003059 run osmo-stp_10.42.42.5(pid=1472): stderr: | [0;m[38;5;43m20221213154330081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154330081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154330081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154330082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154330082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154330082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154330082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:32.173018 run osmo-stp_10.42.42.5(pid=1472): stdout: | (launched: 2022-12-13_15:43:29.907298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:32.303910 run osmo-stp_10.42.42.5(pid=1472): stderr: | [0;m[38;5;43m20221213154330081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154330081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154330081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154330082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154330082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154330082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154330082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:32.452932 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1472): Process ended prematurely: osmo-stp_10.42.42.5(pid=1472) [trial-2391↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1472)] [trial-2391↪emergency:sysmo↪emergency_mo_mt_call.py:19] 15:43:32.461682 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 15:43:32.488149 run osmo-hlr_10.42.42.2(pid=1469): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1469)] 15:43:32.537728 run osmo-hlr_10.42.42.2(pid=1469): stdout: | (launched: 2022-12-13_15:43:28.920220) 15:43:32.588606 run osmo-hlr_10.42.42.2(pid=1469): stderr: | [0;m[1;31m20221213154329100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154329100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154329100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154329100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154329100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154329100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154329112 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154329121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154329121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154329121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:32.659674 run osmo-msc_10.42.42.6(pid=1475): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1475)] 15:43:32.708423 run osmo-msc_10.42.42.6(pid=1475): stdout: | (launched: 2022-12-13_15:43:31.126278) 15:43:32.759077 run osmo-msc_10.42.42.6(pid=1475): stderr: | [0;m[38;5;43m20221213154331613 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154331613 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8939a2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154331613 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154331613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154331613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154331614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154331615 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154331616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154331616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154331616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:43:32.810556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1468): Terminating (SIGTERM) 15:43:32.851440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1471): Terminating (SIGTERM) 15:43:32.893353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1474): Terminating (SIGTERM) 15:43:32.935278 --- ParallelTerminationStrategy: PID 1468 died... 15:43:32.955183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1468): Terminated: ok {rc=0} 15:43:33.000518 --- ParallelTerminationStrategy: PID 1471 died... 15:43:33.019831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1471): Terminated: ok {rc=0} 15:43:33.065128 --- ParallelTerminationStrategy: PID 1474 died... 15:43:33.084498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1474): Terminated: ok {rc=0} 15:43:33.172526 bus /sierra_3: Setting Powered False 15:43:34.274094 bus /sierra_3: Setting Powered False 15:43:35.389020 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 15:43:36.476658 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:36.488616 tst emergency:sysmo: Using 1 x bts (candidates: 1) 15:43:36.528214 tst emergency_preemptive_call.py: using LAC 34605 15:43:36.652049 tst emergency_preemptive_call.py: using RAC 180 15:43:36.780392 tst emergency_preemptive_call.py: using CellId 34605 15:43:36.901439 tst emergency_preemptive_call.py: using BVCI 34606 15:43:37.022225 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:37.033578 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:37.044737 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:37.055808 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:37.067123 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:43:37.078352 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:43:37.196240 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:43:37.320096 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:43:37.438081 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:43:37.557804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:38.072816 run create_hlr_db(pid=1477): Launched 15:43:38.209565 bus /sierra_2: Setting Powered False 15:43:39.274612 run create_hlr_db(pid=1477): Terminated: ok {rc=0} 15:43:39.736679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1479): Launched 15:43:40.050686 run osmo-hlr_10.42.42.2(pid=1480): Launched 15:43:40.170949 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:40.706439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1482): Launched 15:43:41.018566 run osmo-stp_10.42.42.5(pid=1483): Launched 15:43:41.148490 tst emergency_preemptive_call.py: using MSISDN 8211 15:43:41.306721 run osmo-msc_10.42.42.6: Starting osmo-msc 15:43:41.864220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1485): Launched 15:43:42.177872 run osmo-msc_10.42.42.6(pid=1486): Launched 15:43:42.358106 run osmo-stp_10.42.42.5(pid=1483): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1483)] 15:43:42.489271 run osmo-stp_10.42.42.5(pid=1483): stdout: | (launched: 2022-12-13_15:43:40.959875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:42.620352 run osmo-stp_10.42.42.5(pid=1483): stderr: | [0;m[38;5;43m20221213154341133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154341133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154341133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154341134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154341134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154341134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154341134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:42.749495 run osmo-stp_10.42.42.5(pid=1483): stdout: | (launched: 2022-12-13_15:43:40.959875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:42.872485 run osmo-stp_10.42.42.5(pid=1483): stderr: | [0;m[38;5;43m20221213154341133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154341133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154341133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154341134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154341134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154341134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154341134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:43.019854 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1483): Process ended prematurely: osmo-stp_10.42.42.5(pid=1483) [trial-2391↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1483)] [trial-2391↪emergency:sysmo↪emergency_preemptive_call.py:32] 15:43:43.028195 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 15:43:43.054281 run osmo-hlr_10.42.42.2(pid=1480): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1480)] 15:43:43.103033 run osmo-hlr_10.42.42.2(pid=1480): stdout: | (launched: 2022-12-13_15:43:39.991704) 15:43:43.153267 run osmo-hlr_10.42.42.2(pid=1480): stderr: | [0;m[1;31m20221213154340172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154340172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154340172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154340172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154340172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154340172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154340202 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154340212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154340212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154340212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:43.223336 run osmo-msc_10.42.42.6(pid=1486): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1486)] 15:43:43.271100 run osmo-msc_10.42.42.6(pid=1486): stdout: | (launched: 2022-12-13_15:43:42.119193) 15:43:43.321371 run osmo-msc_10.42.42.6(pid=1486): stderr: | [0;m[38;5;43m20221213154342396 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154342396 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff53c018c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154342396 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154342396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154342397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154342397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154342399 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154342399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154342399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154342399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:43:43.371505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1479): Terminating (SIGTERM) 15:43:43.412204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1482): Terminating (SIGTERM) 15:43:43.452391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1485): Terminating (SIGTERM) 15:43:43.492849 --- ParallelTerminationStrategy: PID 1479 died... 15:43:43.512360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1479): Terminated: ok {rc=0} 15:43:43.557328 --- ParallelTerminationStrategy: PID 1482 died... 15:43:43.576424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1482): Terminated: ok {rc=0} 15:43:43.621090 --- ParallelTerminationStrategy: PID 1485 died... 15:43:43.640318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1485): Terminated: ok {rc=0} 15:43:43.727156 bus /sierra_9: Setting Powered False 15:43:44.826085 bus /sierra_9: Setting Powered False 15:43:45.945828 bus /sierra_8: Setting Powered False 15:43:47.056935 bus /sierra_8: Setting Powered False 15:43:48.178757 bus /sierra_3: Setting Powered False 15:43:49.280009 bus /sierra_3: Setting Powered False 15:43:50.397300 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:sysmo --------------------------------------------------------------------- 15:43:51.668276 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:43:51.672926 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 15:43:51.694727 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 15:43:51.735167 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 15:43:51.823293 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 15:43:51.845084 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 15:43:51.885054 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 15:43:52.479568 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 15:43:52.535343 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:52.546618 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:43:52.582297 tst cs_paging_gprs_active.py: using LAC 34606 15:43:52.706105 tst cs_paging_gprs_active.py: using RAC 181 15:43:52.829720 tst cs_paging_gprs_active.py: using CellId 34606 15:43:52.956670 tst cs_paging_gprs_active.py: using BVCI 34607 15:43:53.072773 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:53.083595 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:53.094325 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:53.105076 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:53.115759 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:53.126509 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:53.137328 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:53.147981 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:53.158865 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:53.282361 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:53.401905 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:43:53.614889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:53.933947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1491): Launched 15:43:54.212914 run iperf3-srv_10.42.42.10(pid=1492): Launched 15:43:54.333274 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:43:54.545754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:54.864246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1493): Launched 15:43:55.141546 run iperf3-srv_10.42.42.10(pid=1494): Launched 15:43:55.260228 tst cs_paging_gprs_active.py:38: start network... 15:43:55.472756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:55.963508 run create_hlr_db(pid=1495): Launched 15:43:56.086032 bus /sierra_2: Setting Powered False 15:43:57.148438 run create_hlr_db(pid=1495): Terminated: ok {rc=0} 15:43:57.613146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1497): Launched 15:43:57.955473 run osmo-hlr_10.42.42.2(pid=1498): Launched 15:43:58.087596 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:58.670178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1500): Launched 15:43:59.009236 run osmo-stp_10.42.42.5(pid=1501): Launched 15:43:59.138780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:00.728130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1503): Launched 15:44:00.862123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:01.154534 run patchelf(pid=1504): Launched 15:44:01.368361 run osmo-stp_10.42.42.5(pid=1501): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1501)] 15:44:01.507935 run osmo-stp_10.42.42.5(pid=1501): stdout: | (launched: 2022-12-13_15:43:58.946435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:01.679437 run osmo-stp_10.42.42.5(pid=1501): stderr: | [0;m[38;5;43m20221213154359140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154359141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154359141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154359141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154359142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154359142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154359142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:01.879907 run osmo-stp_10.42.42.5(pid=1501): stdout: | (launched: 2022-12-13_15:43:58.946435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:02.013607 run osmo-stp_10.42.42.5(pid=1501): stderr: | [0;m[38;5;43m20221213154359140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154359141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154359141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154359141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154359142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154359142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154359142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:02.172833 run patchelf(pid=1504): Terminating (SIGINT) 15:44:02.356012 run patchelf(pid=1504): Terminated: ok {rc=0} 15:44:02.485998 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1501): Process ended prematurely: osmo-stp_10.42.42.5(pid=1501) [trial-2391↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1501)] [trial-2391↪gprs:sysmo↪cs_paging_gprs_active.py:38] 15:44:02.495689 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 15:44:02.523423 run osmo-hlr_10.42.42.2(pid=1498): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1498)] 15:44:02.573708 run osmo-hlr_10.42.42.2(pid=1498): stdout: | (launched: 2022-12-13_15:43:57.892354) 15:44:02.624417 run osmo-hlr_10.42.42.2(pid=1498): stderr: | [0;m[1;31m20221213154358094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154358094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154358094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154358094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154358094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154358094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154358106 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154358115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154358115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154358115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:02.675236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1491): Terminating (SIGTERM) 15:44:02.716161 run iperf3-srv_10.42.42.10(pid=1492): Terminating (SIGTERM) 15:44:02.757088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1493): Terminating (SIGTERM) 15:44:02.798157 run iperf3-srv_10.42.42.10(pid=1494): Terminating (SIGTERM) 15:44:02.839700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1497): Terminating (SIGTERM) 15:44:02.881081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1500): Terminating (SIGTERM) 15:44:02.922747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1503): Terminating (SIGTERM) 15:44:02.964003 --- ParallelTerminationStrategy: PID 1491 died... 15:44:02.983494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1491): Terminated: ok {rc=0} 15:44:03.029029 --- ParallelTerminationStrategy: PID 1492 died... 15:44:03.048360 run iperf3-srv_10.42.42.10(pid=1492): Terminated {rc=256} 15:44:03.093445 --- ParallelTerminationStrategy: PID 1493 died... 15:44:03.112675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1493): Terminated: ok {rc=0} 15:44:03.157992 --- ParallelTerminationStrategy: PID 1494 died... 15:44:03.177391 run iperf3-srv_10.42.42.10(pid=1494): Terminated {rc=256} 15:44:03.222297 --- ParallelTerminationStrategy: PID 1497 died... 15:44:03.241636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1497): Terminated: ok {rc=0} 15:44:03.286778 --- ParallelTerminationStrategy: PID 1500 died... 15:44:03.306276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1500): Terminated: ok {rc=0} 15:44:03.351629 --- ParallelTerminationStrategy: PID 1503 died... 15:44:03.371117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1503): Terminated: ok {rc=0} 15:44:03.456699 bus /gobi_0: Setting Powered False 15:44:04.555953 bus /gobi_0: Setting Powered False 15:44:05.673639 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo iperf3.py ---------------------------------------------- 15:44:06.826213 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:06.838433 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:44:06.875785 tst iperf3.py: using LAC 34607 15:44:07.009683 tst iperf3.py: using RAC 182 15:44:07.143883 tst iperf3.py: using CellId 34607 15:44:07.277108 tst iperf3.py: using BVCI 34608 15:44:07.400158 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:07.411287 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:07.422431 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:07.433474 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:07.444314 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:07.455222 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:07.466291 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:07.477273 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:07.488413 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:44:07.608342 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:44:07.822592 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:08.142135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1505): Launched 15:44:08.419955 run iperf3-srv_10.42.42.10(pid=1506): Launched 15:44:08.540590 tst iperf3.py:8: start network... 15:44:08.752357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:09.243625 run create_hlr_db(pid=1507): Launched 15:44:09.366347 bus /gobi_6: Setting Powered False 15:44:10.427998 run create_hlr_db(pid=1507): Terminated: ok {rc=0} 15:44:10.889831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1509): Launched 15:44:11.230616 run osmo-hlr_10.42.42.2(pid=1510): Launched 15:44:11.359625 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:11.947025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1512): Launched 15:44:12.284815 run osmo-stp_10.42.42.5(pid=1513): Launched 15:44:12.414375 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:12.997391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1515): Launched 15:44:13.127785 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:13.414380 run patchelf(pid=1516): Launched 15:44:13.602811 run osmo-stp_10.42.42.5(pid=1513): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1513)] 15:44:13.745075 run osmo-stp_10.42.42.5(pid=1513): stdout: | (launched: 2022-12-13_15:44:12.222025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:13.889801 run osmo-stp_10.42.42.5(pid=1513): stderr: | [0;m[38;5;43m20221213154412417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154412417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154412417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154412417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154412418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154412418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154412418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:14.033909 run osmo-stp_10.42.42.5(pid=1513): stdout: | (launched: 2022-12-13_15:44:12.222025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:14.171836 run osmo-stp_10.42.42.5(pid=1513): stderr: | [0;m[38;5;43m20221213154412417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154412417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154412417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154412417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154412418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154412418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154412418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:14.335172 run patchelf(pid=1516): Terminating (SIGINT) 15:44:14.524507 run patchelf(pid=1516): Terminated: ok {rc=0} 15:44:14.661313 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1513): Process ended prematurely: osmo-stp_10.42.42.5(pid=1513) [trial-2391↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1513)] [trial-2391↪gprs:sysmo↪iperf3.py:8] 15:44:14.672049 tst iperf3.py:8: Test FAILED (7.9 sec) 15:44:14.700667 run osmo-hlr_10.42.42.2(pid=1510): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1510)] 15:44:14.750818 run osmo-hlr_10.42.42.2(pid=1510): stdout: | (launched: 2022-12-13_15:44:11.167383) 15:44:14.802965 run osmo-hlr_10.42.42.2(pid=1510): stderr: | [0;m[1;31m20221213154411370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154411370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154411370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154411370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154411370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154411370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154411383 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154411392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154411392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154411392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:14.856029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1505): Terminating (SIGTERM) 15:44:14.898449 run iperf3-srv_10.42.42.10(pid=1506): Terminating (SIGTERM) 15:44:14.940528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1509): Terminating (SIGTERM) 15:44:14.983216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1512): Terminating (SIGTERM) 15:44:15.025198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1515): Terminating (SIGTERM) 15:44:15.067510 --- ParallelTerminationStrategy: PID 1505 died... 15:44:15.087679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1505): Terminated: ok {rc=0} 15:44:15.134253 --- ParallelTerminationStrategy: PID 1506 died... 15:44:15.153845 run iperf3-srv_10.42.42.10(pid=1506): Terminated {rc=256} 15:44:15.200283 --- ParallelTerminationStrategy: PID 1509 died... 15:44:15.220159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1509): Terminated: ok {rc=0} 15:44:15.266241 --- ParallelTerminationStrategy: PID 1512 died... 15:44:15.285977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1512): Terminated: ok {rc=0} 15:44:15.332466 --- ParallelTerminationStrategy: PID 1515 died... 15:44:15.352344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1515): Terminated: ok {rc=0} 15:44:15.440528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo iperf3m4.py ---------------------------------------------- 15:44:16.599326 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:16.611852 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:44:16.649130 tst iperf3m4.py: using LAC 34608 15:44:16.777430 tst iperf3m4.py: using RAC 183 15:44:16.909604 tst iperf3m4.py: using CellId 34608 15:44:17.045496 tst iperf3m4.py: using BVCI 34609 15:44:17.167835 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:17.179904 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:17.192176 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:17.204044 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:17.217225 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:17.230356 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:17.242506 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:17.254012 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:17.265791 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:44:17.387531 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:44:17.510563 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:44:17.631890 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:44:17.754082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:44:17.983222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:18.324082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1518): Launched 15:44:18.620538 run iperf3-srv_10.42.42.10(pid=1519): Launched 15:44:18.747465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:44:18.976280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:19.318179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1520): Launched 15:44:19.616055 run iperf3-srv_10.42.42.10(pid=1521): Launched 15:44:19.742733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:44:19.971299 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:20.312481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1522): Launched 15:44:20.608232 run iperf3-srv_10.42.42.10(pid=1523): Launched 15:44:20.736003 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:44:20.964051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:21.305070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1524): Launched 15:44:21.619173 run iperf3-srv_10.42.42.10(pid=1525): Launched 15:44:21.747552 tst iperf3m4.py:8: start network... 15:44:21.976006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:22.505316 run create_hlr_db(pid=1526): Launched 15:44:22.643018 bus /gobi_6: Setting Powered False 15:44:23.709627 run create_hlr_db(pid=1526): Terminated: ok {rc=0} 15:44:24.161647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1528): Launched 15:44:24.481543 run osmo-hlr_10.42.42.2(pid=1529): Launched 15:44:24.606590 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:25.167714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1531): Launched 15:44:25.487278 run osmo-stp_10.42.42.5(pid=1532): Launched 15:44:25.610839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:26.158209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1534): Launched 15:44:26.279322 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:26.548514 run patchelf(pid=1535): Launched 15:44:26.726192 run osmo-stp_10.42.42.5(pid=1532): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1532)] 15:44:26.860274 run osmo-stp_10.42.42.5(pid=1532): stdout: | (launched: 2022-12-13_15:44:25.427429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:26.996437 run osmo-stp_10.42.42.5(pid=1532): stderr: | [0;m[38;5;43m20221213154425597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154425597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154425598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154425598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154425599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154425599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154425599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:27.132870 run osmo-stp_10.42.42.5(pid=1532): stdout: | (launched: 2022-12-13_15:44:25.427429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:27.262703 run osmo-stp_10.42.42.5(pid=1532): stderr: | [0;m[38;5;43m20221213154425597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154425597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154425598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154425598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154425599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154425599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154425599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:27.416332 run patchelf(pid=1535): Terminating (SIGINT) 15:44:27.594711 run patchelf(pid=1535): Terminated: ok {rc=0} 15:44:27.724015 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1532): Process ended prematurely: osmo-stp_10.42.42.5(pid=1532) [trial-2391↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1532)] [trial-2391↪gprs:sysmo↪iperf3m4.py:8] 15:44:27.733793 tst iperf3m4.py:8: Test FAILED (11.2 sec) 15:44:27.761400 run osmo-hlr_10.42.42.2(pid=1529): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1529)] 15:44:27.810728 run osmo-hlr_10.42.42.2(pid=1529): stdout: | (launched: 2022-12-13_15:44:24.421396) 15:44:27.860743 run osmo-hlr_10.42.42.2(pid=1529): stderr: | [0;m[1;31m20221213154424598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154424598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154424598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154424598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154424599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154424599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154424613 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154424621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154424621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154424621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:27.911521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1518): Terminating (SIGTERM) 15:44:27.951873 run iperf3-srv_10.42.42.10(pid=1519): Terminating (SIGTERM) 15:44:27.992536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1520): Terminating (SIGTERM) 15:44:28.034017 run iperf3-srv_10.42.42.10(pid=1521): Terminating (SIGTERM) 15:44:28.074873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1522): Terminating (SIGTERM) 15:44:28.116226 run iperf3-srv_10.42.42.10(pid=1523): Terminating (SIGTERM) 15:44:28.158574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1524): Terminating (SIGTERM) 15:44:28.199931 run iperf3-srv_10.42.42.10(pid=1525): Terminating (SIGTERM) 15:44:28.242624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1528): Terminating (SIGTERM) 15:44:28.283953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1531): Terminating (SIGTERM) 15:44:28.325402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1534): Terminating (SIGTERM) 15:44:28.366903 --- ParallelTerminationStrategy: PID 1518 died... 15:44:28.386812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1518): Terminated: ok {rc=0} 15:44:28.432125 --- ParallelTerminationStrategy: PID 1519 died... 15:44:28.451412 run iperf3-srv_10.42.42.10(pid=1519): Terminated {rc=256} 15:44:28.495902 --- ParallelTerminationStrategy: PID 1520 died... 15:44:28.515186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1520): Terminated: ok {rc=0} 15:44:28.560215 --- ParallelTerminationStrategy: PID 1521 died... 15:44:28.579390 run iperf3-srv_10.42.42.10(pid=1521): Terminated {rc=256} 15:44:28.624356 --- ParallelTerminationStrategy: PID 1522 died... 15:44:28.643682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1522): Terminated: ok {rc=0} 15:44:28.688502 --- ParallelTerminationStrategy: PID 1523 died... 15:44:28.707725 run iperf3-srv_10.42.42.10(pid=1523): Terminated {rc=256} 15:44:28.752428 --- ParallelTerminationStrategy: PID 1524 died... 15:44:28.771875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1524): Terminated: ok {rc=0} 15:44:28.816578 --- ParallelTerminationStrategy: PID 1525 died... 15:44:28.835968 run iperf3-srv_10.42.42.10(pid=1525): Terminated {rc=256} 15:44:28.880578 --- ParallelTerminationStrategy: PID 1528 died... 15:44:28.899979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1528): Terminated: ok {rc=0} 15:44:28.944809 --- ParallelTerminationStrategy: PID 1531 died... 15:44:28.964472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1531): Terminated: ok {rc=0} 15:44:29.009424 --- ParallelTerminationStrategy: PID 1534 died... 15:44:29.028819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1534): Terminated: ok {rc=0} 15:44:29.116249 bus /gobi_4: Setting Powered False 15:44:30.217105 bus /gobi_4: Setting Powered False 15:44:31.339909 bus /gobi_1: Setting Powered False 15:44:32.457163 bus /gobi_1: Setting Powered False 15:44:33.573602 bus /gobi_0: Setting Powered False 15:44:34.669977 bus /gobi_0: Setting Powered False 15:44:35.787777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo ping.py ---------------------------------------------- 15:44:36.894123 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:36.906322 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:44:36.943319 tst ping.py: using LAC 34609 15:44:37.076371 tst ping.py: using RAC 184 15:44:37.208013 tst ping.py: using CellId 34609 15:44:37.339680 tst ping.py: using BVCI 34610 15:44:37.462502 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:37.473861 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:37.485212 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:37.496459 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:37.507809 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:37.519169 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:37.530723 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:37.542090 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:44:37.663333 tst ping.py:19: start network... 15:44:37.889549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:38.405272 run create_hlr_db(pid=1536): Launched 15:44:38.540020 bus /gobi_6: Setting Powered False 15:44:39.605739 run create_hlr_db(pid=1536): Terminated: ok {rc=0} 15:44:40.052016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1538): Launched 15:44:40.365867 run osmo-hlr_10.42.42.2(pid=1539): Launched 15:44:40.484744 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:41.021694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1541): Launched 15:44:41.334013 run osmo-stp_10.42.42.5(pid=1542): Launched 15:44:41.451819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:41.989099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1544): Launched 15:44:42.108391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:42.372327 run patchelf(pid=1545): Launched 15:44:42.547421 run osmo-stp_10.42.42.5(pid=1542): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1542)] 15:44:42.679415 run osmo-stp_10.42.42.5(pid=1542): stdout: | (launched: 2022-12-13_15:44:41.274938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:42.813851 run osmo-stp_10.42.42.5(pid=1542): stderr: | [0;m[38;5;43m20221213154441446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154441446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154441446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154441447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154441449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154441449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154441449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:42.947952 run osmo-stp_10.42.42.5(pid=1542): stdout: | (launched: 2022-12-13_15:44:41.274938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:43.075063 run osmo-stp_10.42.42.5(pid=1542): stderr: | [0;m[38;5;43m20221213154441446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154441446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154441446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154441447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154441449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154441449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154441449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:43.226153 run patchelf(pid=1545): Terminating (SIGINT) 15:44:43.400386 run patchelf(pid=1545): Terminated: ok {rc=0} 15:44:43.525879 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1542): Process ended prematurely: osmo-stp_10.42.42.5(pid=1542) [trial-2391↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1542)] [trial-2391↪gprs:sysmo↪ping.py:22] 15:44:43.534760 tst ping.py:22: Test FAILED (6.6 sec) 15:44:43.561688 run osmo-hlr_10.42.42.2(pid=1539): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1539)] 15:44:43.610848 run osmo-hlr_10.42.42.2(pid=1539): stdout: | (launched: 2022-12-13_15:44:40.306972) 15:44:43.661894 run osmo-hlr_10.42.42.2(pid=1539): stderr: | [0;m[1;31m20221213154440489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154440489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154440489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154440489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154440489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154440490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154440501 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154440510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154440511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154440511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:43.712173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1538): Terminating (SIGTERM) 15:44:43.753222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1541): Terminating (SIGTERM) 15:44:43.794899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1544): Terminating (SIGTERM) 15:44:43.835971 --- ParallelTerminationStrategy: PID 1538 died... 15:44:43.855795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1538): Terminated: ok {rc=0} 15:44:43.900803 --- ParallelTerminationStrategy: PID 1541 died... 15:44:43.920621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1541): Terminated: ok {rc=0} 15:44:43.965630 --- ParallelTerminationStrategy: PID 1544 died... 15:44:43.984850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1544): Terminated: ok {rc=0} 15:44:44.072658 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 15:44:45.161615 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:45.172894 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:44:45.211132 tst ping_idle_ping.py: using LAC 34610 15:44:45.333377 tst ping_idle_ping.py: using RAC 185 15:44:45.454579 tst ping_idle_ping.py: using CellId 34610 15:44:45.574252 tst ping_idle_ping.py: using BVCI 34611 15:44:45.688530 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:45.699258 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:45.709864 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:45.720330 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:45.731102 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:45.741931 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:45.752795 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:44:45.764130 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:44:45.897987 tst ping_idle_ping.py:24: start network... 15:44:46.116666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:46.608536 run create_hlr_db(pid=1546): Launched 15:44:46.738959 bus /gobi_6: Setting Powered False 15:44:47.804055 run create_hlr_db(pid=1546): Terminated: ok {rc=0} 15:44:48.249953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1548): Launched 15:44:48.563348 run osmo-hlr_10.42.42.2(pid=1549): Launched 15:44:48.683423 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:49.215836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1551): Launched 15:44:49.529421 run osmo-stp_10.42.42.5(pid=1552): Launched 15:44:49.649498 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:50.188326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1554): Launched 15:44:50.310534 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:50.576124 run patchelf(pid=1555): Launched 15:44:50.750610 run osmo-stp_10.42.42.5(pid=1552): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1552)] 15:44:50.883570 run osmo-stp_10.42.42.5(pid=1552): stdout: | (launched: 2022-12-13_15:44:49.470506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:51.018329 run osmo-stp_10.42.42.5(pid=1552): stderr: | [0;m[38;5;43m20221213154449643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154449643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154449643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154449644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154449646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154449646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154449646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:51.153519 run osmo-stp_10.42.42.5(pid=1552): stdout: | (launched: 2022-12-13_15:44:49.470506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:51.281835 run osmo-stp_10.42.42.5(pid=1552): stderr: | [0;m[38;5;43m20221213154449643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154449643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154449643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154449644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154449646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154449646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154449646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:51.433773 run patchelf(pid=1555): Terminating (SIGINT) 15:44:51.608887 run patchelf(pid=1555): Terminated: ok {rc=0} 15:44:51.735012 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1552): Process ended prematurely: osmo-stp_10.42.42.5(pid=1552) [trial-2391↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1552)] [trial-2391↪gprs:sysmo↪ping_idle_ping.py:27] 15:44:51.743975 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 15:44:51.770950 run osmo-hlr_10.42.42.2(pid=1549): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1549)] 15:44:51.820165 run osmo-hlr_10.42.42.2(pid=1549): stdout: | (launched: 2022-12-13_15:44:48.504374) 15:44:51.871218 run osmo-hlr_10.42.42.2(pid=1549): stderr: | [0;m[1;31m20221213154448686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154448686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154448686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154448686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154448686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154448686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154448713 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154448722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154448723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154448723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:51.922390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1548): Terminating (SIGTERM) 15:44:51.962832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1551): Terminating (SIGTERM) 15:44:52.003581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1554): Terminating (SIGTERM) 15:44:52.044864 --- ParallelTerminationStrategy: PID 1548 died... 15:44:52.064824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1548): Terminated: ok {rc=0} 15:44:52.110440 --- ParallelTerminationStrategy: PID 1551 died... 15:44:52.129970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1551): Terminated: ok {rc=0} 15:44:52.175159 --- ParallelTerminationStrategy: PID 1554 died... 15:44:52.194666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1554): Terminated: ok {rc=0} 15:44:52.283223 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 15:44:53.571268 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:44:53.576652 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 15:44:53.597767 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 15:44:53.637851 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 15:44:53.726136 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 15:44:53.747001 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 15:44:53.786040 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 15:44:54.381794 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 15:44:54.433866 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:54.444753 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:44:54.480052 tst cs_paging_gprs_active.py: using LAC 34611 15:44:54.603488 tst cs_paging_gprs_active.py: using RAC 186 15:44:54.728558 tst cs_paging_gprs_active.py: using CellId 34611 15:44:54.851809 tst cs_paging_gprs_active.py: using BVCI 34612 15:44:54.969475 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:54.980529 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:54.991408 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:55.002288 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:55.013560 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:55.024668 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:55.036151 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:55.047435 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:55.058903 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:55.183079 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:55.303787 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:44:55.518053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:55.838440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1560): Launched 15:44:56.118754 run iperf3-srv_10.42.42.10(pid=1561): Launched 15:44:56.240007 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:44:56.454322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:56.775371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1562): Launched 15:44:57.055952 run iperf3-srv_10.42.42.10(pid=1563): Launched 15:44:57.175504 tst cs_paging_gprs_active.py:38: start network... 15:44:57.389765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:57.883598 run create_hlr_db(pid=1564): Launched 15:44:58.006374 bus /gobi_6: Setting Powered False 15:44:59.068599 run create_hlr_db(pid=1564): Terminated: ok {rc=0} 15:44:59.533859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1566): Launched 15:44:59.875127 run osmo-hlr_10.42.42.2(pid=1567): Launched 15:45:00.005081 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:00.594224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1569): Launched 15:45:00.953704 run osmo-stp_10.42.42.5(pid=1570): Launched 15:45:01.245493 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:01.853688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1575): Launched 15:45:01.990113 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:02.269095 run patchelf(pid=1576): Launched 15:45:02.469091 run osmo-stp_10.42.42.5(pid=1570): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1570)] 15:45:02.613169 run osmo-stp_10.42.42.5(pid=1570): stdout: | (launched: 2022-12-13_15:45:00.880820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:02.758021 run osmo-stp_10.42.42.5(pid=1570): stderr: | [0;m[38;5;43m20221213154501103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154501103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154501104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154501105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154501108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154501108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154501108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:02.903190 run osmo-stp_10.42.42.5(pid=1570): stdout: | (launched: 2022-12-13_15:45:00.880820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:03.042185 run osmo-stp_10.42.42.5(pid=1570): stderr: | [0;m[38;5;43m20221213154501103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154501103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154501104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154501105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154501108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154501108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154501108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:03.206566 run patchelf(pid=1576): Terminating (SIGINT) 15:45:03.396537 run patchelf(pid=1576): Terminated: ok {rc=0} 15:45:03.533556 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1570): Process ended prematurely: osmo-stp_10.42.42.5(pid=1570) [trial-2391↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1570)] [trial-2391↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 15:45:03.544143 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 15:45:03.573399 run osmo-hlr_10.42.42.2(pid=1567): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1567)] 15:45:03.624693 run osmo-hlr_10.42.42.2(pid=1567): stdout: | (launched: 2022-12-13_15:44:59.811727) 15:45:03.677787 run osmo-hlr_10.42.42.2(pid=1567): stderr: | [0;m[1;31m20221213154500012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154500012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154500012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154500012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154500013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154500013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154500025 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154500034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154500034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154500034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:03.731287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1560): Terminating (SIGTERM) 15:45:03.774246 run iperf3-srv_10.42.42.10(pid=1561): Terminating (SIGTERM) 15:45:03.818612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1562): Terminating (SIGTERM) 15:45:03.862534 run iperf3-srv_10.42.42.10(pid=1563): Terminating (SIGTERM) 15:45:03.905451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1566): Terminating (SIGTERM) 15:45:03.948607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1569): Terminating (SIGTERM) 15:45:03.991479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1575): Terminating (SIGTERM) 15:45:04.034203 --- ParallelTerminationStrategy: PID 1560 died... 15:45:04.054418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1560): Terminated: ok {rc=0} 15:45:04.101535 --- ParallelTerminationStrategy: PID 1561 died... 15:45:04.121194 run iperf3-srv_10.42.42.10(pid=1561): Terminated {rc=256} 15:45:04.167789 --- ParallelTerminationStrategy: PID 1562 died... 15:45:04.187570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1562): Terminated: ok {rc=0} 15:45:04.234259 --- ParallelTerminationStrategy: PID 1563 died... 15:45:04.254207 run iperf3-srv_10.42.42.10(pid=1563): Terminated {rc=256} 15:45:04.300698 --- ParallelTerminationStrategy: PID 1566 died... 15:45:04.320542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1566): Terminated: ok {rc=0} 15:45:04.367077 --- ParallelTerminationStrategy: PID 1569 died... 15:45:04.387043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1569): Terminated: ok {rc=0} 15:45:04.433980 --- ParallelTerminationStrategy: PID 1575 died... 15:45:04.453933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1575): Terminated: ok {rc=0} 15:45:04.544669 bus /gobi_0: Setting Powered False 15:45:05.645383 bus /gobi_0: Setting Powered False 15:45:06.762876 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 15:45:07.916376 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:07.928680 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:45:07.966961 tst iperf3.py: using LAC 34612 15:45:08.105793 tst iperf3.py: using RAC 187 15:45:08.230633 tst iperf3.py: using CellId 34612 15:45:08.354315 tst iperf3.py: using BVCI 34613 15:45:08.472520 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:08.483627 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:08.494651 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:08.505587 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:08.516422 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:08.527574 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:08.538427 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:08.549723 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:08.561377 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:08.685118 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:45:08.899307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:09.219633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1577): Launched 15:45:09.499686 run iperf3-srv_10.42.42.10(pid=1578): Launched 15:45:09.620566 tst iperf3.py:8: start network... 15:45:09.833651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:10.326710 run create_hlr_db(pid=1579): Launched 15:45:10.448936 bus /gobi_6: Setting Powered False 15:45:11.511595 run create_hlr_db(pid=1579): Terminated: ok {rc=0} 15:45:11.974820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1581): Launched 15:45:12.315661 run osmo-hlr_10.42.42.2(pid=1582): Launched 15:45:12.445747 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:13.030020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1584): Launched 15:45:13.370506 run osmo-stp_10.42.42.5(pid=1585): Launched 15:45:13.500101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:14.088413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1587): Launched 15:45:14.219492 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:14.507612 run patchelf(pid=1588): Launched 15:45:14.697138 run osmo-stp_10.42.42.5(pid=1585): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1585)] 15:45:14.840173 run osmo-stp_10.42.42.5(pid=1585): stdout: | (launched: 2022-12-13_15:45:13.307080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:14.985309 run osmo-stp_10.42.42.5(pid=1585): stderr: | [0;m[38;5;43m20221213154513505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154513505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154513505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154513506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154513506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154513506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154513506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:15.130390 run osmo-stp_10.42.42.5(pid=1585): stdout: | (launched: 2022-12-13_15:45:13.307080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:15.268449 run osmo-stp_10.42.42.5(pid=1585): stderr: | [0;m[38;5;43m20221213154513505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154513505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154513505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154513506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154513506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154513506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154513506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:15.432678 run patchelf(pid=1588): Terminating (SIGINT) 15:45:15.622840 run patchelf(pid=1588): Terminated: ok {rc=0} 15:45:15.759764 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1585): Process ended prematurely: osmo-stp_10.42.42.5(pid=1585) [trial-2391↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1585)] [trial-2391↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 15:45:15.770208 tst iperf3.py:8: Test FAILED (7.9 sec) 15:45:15.799189 run osmo-hlr_10.42.42.2(pid=1582): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1582)] 15:45:15.862792 run osmo-hlr_10.42.42.2(pid=1582): stdout: | (launched: 2022-12-13_15:45:12.252328) 15:45:15.919228 run osmo-hlr_10.42.42.2(pid=1582): stderr: | [0;m[1;31m20221213154512453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154512453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154512453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154512453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154512453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154512453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154512469 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154512478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154512478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154512478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:15.973640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1577): Terminating (SIGTERM) 15:45:16.017426 run iperf3-srv_10.42.42.10(pid=1578): Terminating (SIGTERM) 15:45:16.064143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1581): Terminating (SIGTERM) 15:45:16.108940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1584): Terminating (SIGTERM) 15:45:16.154262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1587): Terminating (SIGTERM) 15:45:16.198970 --- ParallelTerminationStrategy: PID 1577 died... 15:45:16.219593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1577): Terminated: ok {rc=0} 15:45:16.267102 --- ParallelTerminationStrategy: PID 1578 died... 15:45:16.287341 run iperf3-srv_10.42.42.10(pid=1578): Terminated {rc=256} 15:45:16.334967 --- ParallelTerminationStrategy: PID 1581 died... 15:45:16.355483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1581): Terminated: ok {rc=0} 15:45:16.402935 --- ParallelTerminationStrategy: PID 1584 died... 15:45:16.423557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1584): Terminated: ok {rc=0} 15:45:16.471177 --- ParallelTerminationStrategy: PID 1587 died... 15:45:16.491736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1587): Terminated: ok {rc=0} 15:45:16.582377 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 15:45:17.732651 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:17.744465 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:45:17.786180 tst iperf3m4.py: using LAC 34613 15:45:17.909988 tst iperf3m4.py: using RAC 188 15:45:18.035889 tst iperf3m4.py: using CellId 34613 15:45:18.161487 tst iperf3m4.py: using BVCI 34614 15:45:18.285775 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:18.297337 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:18.308727 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:18.320280 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:18.331593 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:18.343018 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:18.354422 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:18.365554 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:18.376736 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:18.496670 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:18.623754 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:18.749646 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:18.869618 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:45:19.084386 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:19.407558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1589): Launched 15:45:19.689633 run iperf3-srv_10.42.42.10(pid=1590): Launched 15:45:19.811858 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:45:20.024408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:20.345486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1591): Launched 15:45:20.623936 run iperf3-srv_10.42.42.10(pid=1592): Launched 15:45:20.745109 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:45:20.958222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:21.279692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1593): Launched 15:45:21.559563 run iperf3-srv_10.42.42.10(pid=1594): Launched 15:45:21.680490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:45:21.893546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:22.215383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1595): Launched 15:45:22.495125 run iperf3-srv_10.42.42.10(pid=1596): Launched 15:45:22.615872 tst iperf3m4.py:8: start network... 15:45:22.828580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:23.323598 run create_hlr_db(pid=1597): Launched 15:45:23.446118 bus /gobi_6: Setting Powered False 15:45:24.508285 run create_hlr_db(pid=1597): Terminated: ok {rc=0} 15:45:24.971994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1599): Launched 15:45:25.314676 run osmo-hlr_10.42.42.2(pid=1600): Launched 15:45:25.444518 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:26.031778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1602): Launched 15:45:26.372854 run osmo-stp_10.42.42.5(pid=1603): Launched 15:45:26.502967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:27.087821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1605): Launched 15:45:27.218754 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:27.505885 run patchelf(pid=1606): Launched 15:45:27.693913 run osmo-stp_10.42.42.5(pid=1603): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1603)] 15:45:27.836634 run osmo-stp_10.42.42.5(pid=1603): stdout: | (launched: 2022-12-13_15:45:26.309457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:27.981504 run osmo-stp_10.42.42.5(pid=1603): stderr: | [0;m[38;5;43m20221213154526503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154526503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154526504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154526504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154526504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154526505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154526505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:28.126167 run osmo-stp_10.42.42.5(pid=1603): stdout: | (launched: 2022-12-13_15:45:26.309457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:28.264406 run osmo-stp_10.42.42.5(pid=1603): stderr: | [0;m[38;5;43m20221213154526503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154526503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154526504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154526504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154526504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154526505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154526505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:28.428102 run patchelf(pid=1606): Terminating (SIGINT) 15:45:28.617299 run patchelf(pid=1606): Terminated: ok {rc=0} 15:45:28.753527 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1603): Process ended prematurely: osmo-stp_10.42.42.5(pid=1603) [trial-2391↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1603)] [trial-2391↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 15:45:28.763809 tst iperf3m4.py:8: Test FAILED (11.1 sec) 15:45:28.793186 run osmo-hlr_10.42.42.2(pid=1600): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1600)] 15:45:28.844206 run osmo-hlr_10.42.42.2(pid=1600): stdout: | (launched: 2022-12-13_15:45:25.251124) 15:45:28.897528 run osmo-hlr_10.42.42.2(pid=1600): stderr: | [0;m[1;31m20221213154525449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154525449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154525449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154525450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154525450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154525450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154525463 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154525474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154525474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154525474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:28.951339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1589): Terminating (SIGTERM) 15:45:28.994195 run iperf3-srv_10.42.42.10(pid=1590): Terminating (SIGTERM) 15:45:29.037184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1591): Terminating (SIGTERM) 15:45:29.080173 run iperf3-srv_10.42.42.10(pid=1592): Terminating (SIGTERM) 15:45:29.122813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1593): Terminating (SIGTERM) 15:45:29.166052 run iperf3-srv_10.42.42.10(pid=1594): Terminating (SIGTERM) 15:45:29.208838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1595): Terminating (SIGTERM) 15:45:29.251846 run iperf3-srv_10.42.42.10(pid=1596): Terminating (SIGTERM) 15:45:29.294794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1599): Terminating (SIGTERM) 15:45:29.337808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1602): Terminating (SIGTERM) 15:45:29.380624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1605): Terminating (SIGTERM) 15:45:29.423860 --- ParallelTerminationStrategy: PID 1589 died... 15:45:29.444456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1589): Terminated: ok {rc=0} 15:45:29.491905 --- ParallelTerminationStrategy: PID 1590 died... 15:45:29.511839 run iperf3-srv_10.42.42.10(pid=1590): Terminated {rc=256} 15:45:29.559226 --- ParallelTerminationStrategy: PID 1591 died... 15:45:29.579292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1591): Terminated: ok {rc=0} 15:45:29.626039 --- ParallelTerminationStrategy: PID 1592 died... 15:45:29.645897 run iperf3-srv_10.42.42.10(pid=1592): Terminated {rc=256} 15:45:29.692705 --- ParallelTerminationStrategy: PID 1593 died... 15:45:29.712699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1593): Terminated: ok {rc=0} 15:45:29.759380 --- ParallelTerminationStrategy: PID 1594 died... 15:45:29.779332 run iperf3-srv_10.42.42.10(pid=1594): Terminated {rc=256} 15:45:29.826176 --- ParallelTerminationStrategy: PID 1595 died... 15:45:29.846216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1595): Terminated: ok {rc=0} 15:45:29.893565 --- ParallelTerminationStrategy: PID 1596 died... 15:45:29.913578 run iperf3-srv_10.42.42.10(pid=1596): Terminated {rc=256} 15:45:29.960422 --- ParallelTerminationStrategy: PID 1599 died... 15:45:29.980448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1599): Terminated: ok {rc=0} 15:45:30.027329 --- ParallelTerminationStrategy: PID 1602 died... 15:45:30.047548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1602): Terminated: ok {rc=0} 15:45:30.094643 --- ParallelTerminationStrategy: PID 1605 died... 15:45:30.114658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1605): Terminated: ok {rc=0} 15:45:30.204475 bus /gobi_4: Setting Powered False 15:45:31.308893 bus /gobi_4: Setting Powered False 15:45:32.428165 bus /gobi_1: Setting Powered False 15:45:33.528452 bus /gobi_1: Setting Powered False 15:45:34.646270 bus /gobi_0: Setting Powered False 15:45:35.747141 bus /gobi_0: Setting Powered False 15:45:36.866435 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 15:45:37.971449 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:37.983967 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:45:38.022731 tst ping.py: using LAC 34614 15:45:38.155124 tst ping.py: using RAC 189 15:45:38.288157 tst ping.py: using CellId 34614 15:45:38.422608 tst ping.py: using BVCI 34615 15:45:38.543634 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:38.555076 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:38.566442 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:38.577713 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:38.589676 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:38.601476 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:38.613323 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:38.625089 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:38.750432 tst ping.py:19: start network... 15:45:38.976734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:39.494359 run create_hlr_db(pid=1607): Launched 15:45:39.616205 bus /gobi_6: Setting Powered False 15:45:40.677949 run create_hlr_db(pid=1607): Terminated: ok {rc=0} 15:45:41.145064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1609): Launched 15:45:41.480428 run osmo-hlr_10.42.42.2(pid=1610): Launched 15:45:41.610538 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:42.183475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1612): Launched 15:45:42.516754 run osmo-stp_10.42.42.5(pid=1613): Launched 15:45:42.644584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:43.218233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1615): Launched 15:45:43.346427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:43.628857 run patchelf(pid=1616): Launched 15:45:43.814853 run osmo-stp_10.42.42.5(pid=1613): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1613)] 15:45:43.955256 run osmo-stp_10.42.42.5(pid=1613): stdout: | (launched: 2022-12-13_15:45:42.454595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:44.097350 run osmo-stp_10.42.42.5(pid=1613): stderr: | [0;m[38;5;43m20221213154542651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154542651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154542651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154542651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154542652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154542652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154542652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:44.239606 run osmo-stp_10.42.42.5(pid=1613): stdout: | (launched: 2022-12-13_15:45:42.454595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:44.375797 run osmo-stp_10.42.42.5(pid=1613): stderr: | [0;m[38;5;43m20221213154542651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154542651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154542651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154542651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154542652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154542652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154542652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:44.536567 run patchelf(pid=1616): Terminating (SIGINT) 15:45:44.722509 run patchelf(pid=1616): Terminated: ok {rc=0} 15:45:44.856329 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1613): Process ended prematurely: osmo-stp_10.42.42.5(pid=1613) [trial-2391↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1613)] [trial-2391↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 15:45:44.866103 tst ping.py:22: Test FAILED (6.9 sec) 15:45:44.894998 run osmo-hlr_10.42.42.2(pid=1610): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1610)] 15:45:44.946365 run osmo-hlr_10.42.42.2(pid=1610): stdout: | (launched: 2022-12-13_15:45:41.418094) 15:45:44.999151 run osmo-hlr_10.42.42.2(pid=1610): stderr: | [0;m[1;31m20221213154541619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154541619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154541619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154541619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154541620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154541620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154541649 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154541660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154541660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154541660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:45.052359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1609): Terminating (SIGTERM) 15:45:45.095092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1612): Terminating (SIGTERM) 15:45:45.138109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1615): Terminating (SIGTERM) 15:45:45.181014 --- ParallelTerminationStrategy: PID 1609 died... 15:45:45.201403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1609): Terminated: ok {rc=0} 15:45:45.248795 --- ParallelTerminationStrategy: PID 1612 died... 15:45:45.269320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1612): Terminated: ok {rc=0} 15:45:45.316323 --- ParallelTerminationStrategy: PID 1615 died... 15:45:45.336491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1615): Terminated: ok {rc=0} 15:45:45.426931 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 15:45:46.517848 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:46.534211 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:45:46.582981 tst ping_idle_ping.py: using LAC 34615 15:45:46.709483 tst ping_idle_ping.py: using RAC 190 15:45:46.841954 tst ping_idle_ping.py: using CellId 34615 15:45:46.969007 tst ping_idle_ping.py: using BVCI 34616 15:45:47.093071 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:47.106046 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:47.118592 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:47.130941 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:47.143656 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:47.156362 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:47.169081 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:47.181839 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:47.314728 tst ping_idle_ping.py:24: start network... 15:45:47.539988 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:48.057060 run create_hlr_db(pid=1617): Launched 15:45:48.193919 bus /gobi_6: Setting Powered False 15:45:49.259753 run create_hlr_db(pid=1617): Terminated: ok {rc=0} 15:45:49.707738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1619): Launched 15:45:50.023287 run osmo-hlr_10.42.42.2(pid=1620): Launched 15:45:50.145097 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:50.688085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1622): Launched 15:45:51.004546 run osmo-stp_10.42.42.5(pid=1623): Launched 15:45:51.125580 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:51.665522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1625): Launched 15:45:51.794562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:52.069226 run patchelf(pid=1627): Launched 15:45:52.242840 run osmo-stp_10.42.42.5(pid=1623): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1623)] 15:45:52.375207 run osmo-stp_10.42.42.5(pid=1623): stdout: | (launched: 2022-12-13_15:45:50.945800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:52.509811 run osmo-stp_10.42.42.5(pid=1623): stderr: | [0;m[38;5;43m20221213154551120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154551120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154551121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154551121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154551122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154551122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154551122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:52.643541 run osmo-stp_10.42.42.5(pid=1623): stdout: | (launched: 2022-12-13_15:45:50.945800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:52.770830 run osmo-stp_10.42.42.5(pid=1623): stderr: | [0;m[38;5;43m20221213154551120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154551120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154551121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154551121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154551122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154551122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154551122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:52.922023 run patchelf(pid=1627): Terminating (SIGINT) 15:45:53.097391 run patchelf(pid=1627): Terminated: ok {rc=0} 15:45:53.223406 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1623): Process ended prematurely: osmo-stp_10.42.42.5(pid=1623) [trial-2391↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1623)] [trial-2391↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 15:45:53.232541 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 15:45:53.259532 run osmo-hlr_10.42.42.2(pid=1620): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1620)] 15:45:53.308340 run osmo-hlr_10.42.42.2(pid=1620): stdout: | (launched: 2022-12-13_15:45:49.964144) 15:45:53.358736 run osmo-hlr_10.42.42.2(pid=1620): stderr: | [0;m[1;31m20221213154550142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154550142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154550142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154550142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154550143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154550143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154550155 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154550165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154550166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154550166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:53.409461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1619): Terminating (SIGTERM) 15:45:53.450051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1622): Terminating (SIGTERM) 15:45:53.490506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1625): Terminating (SIGTERM) 15:45:53.531213 --- ParallelTerminationStrategy: PID 1619 died... 15:45:53.550776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1619): Terminated: ok {rc=0} 15:45:53.595676 --- ParallelTerminationStrategy: PID 1622 died... 15:45:53.614852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1622): Terminated: ok {rc=0} 15:45:53.659627 --- ParallelTerminationStrategy: PID 1625 died... 15:45:53.678797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1625): Terminated: ok {rc=0} 15:45:53.764527 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 15:45:55.061154 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:45:55.068207 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 15:45:55.090424 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 15:45:55.130985 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 15:45:55.222838 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 15:45:55.245083 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 15:45:55.284897 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 15:45:55.880100 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 15:45:55.934234 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:55.945698 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:45:56.004742 tst cs_paging_gprs_active.py: using LAC 34616 15:45:56.138531 tst cs_paging_gprs_active.py: using RAC 191 15:45:56.270861 tst cs_paging_gprs_active.py: using CellId 34616 15:45:56.405411 tst cs_paging_gprs_active.py: using BVCI 34617 15:45:56.529885 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:56.541478 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:56.552721 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:56.564113 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:56.575369 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:56.586697 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:56.598131 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:56.609376 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:56.620748 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:56.740796 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:56.865795 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:45:57.096231 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:57.437260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1631): Launched 15:45:57.735031 run iperf3-srv_10.42.42.10(pid=1632): Launched 15:45:57.861652 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:45:58.090548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:58.432258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1633): Launched 15:45:58.728402 run iperf3-srv_10.42.42.10(pid=1634): Launched 15:45:58.854868 tst cs_paging_gprs_active.py:38: start network... 15:45:59.084453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:59.611519 run create_hlr_db(pid=1635): Launched 15:45:59.750006 bus /gobi_6: Setting Powered False 15:46:00.816357 run create_hlr_db(pid=1635): Terminated: ok {rc=0} 15:46:01.304127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1637): Launched 15:46:01.645664 run osmo-hlr_10.42.42.2(pid=1638): Launched 15:46:01.893270 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:02.551063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1640): Launched 15:46:02.893173 run osmo-stp_10.42.42.5(pid=1641): Launched 15:46:03.024470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:03.611015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1643): Launched 15:46:03.740662 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:04.029374 run patchelf(pid=1644): Launched 15:46:04.219382 run osmo-stp_10.42.42.5(pid=1641): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1641)] 15:46:04.362462 run osmo-stp_10.42.42.5(pid=1641): stdout: | (launched: 2022-12-13_15:46:02.829826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:04.507788 run osmo-stp_10.42.42.5(pid=1641): stderr: | [0;m[38;5;43m20221213154603024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154603024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154603024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154603025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154603025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154603025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154603025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:04.652529 run osmo-stp_10.42.42.5(pid=1641): stdout: | (launched: 2022-12-13_15:46:02.829826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:04.790880 run osmo-stp_10.42.42.5(pid=1641): stderr: | [0;m[38;5;43m20221213154603024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154603024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154603024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154603025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154603025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154603025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154603025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:04.955305 run patchelf(pid=1644): Terminating (SIGINT) 15:46:05.146059 run patchelf(pid=1644): Terminated: ok {rc=0} 15:46:05.283414 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1641): Process ended prematurely: osmo-stp_10.42.42.5(pid=1641) [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1641)] [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 15:46:05.293584 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 15:46:05.322498 run osmo-hlr_10.42.42.2(pid=1638): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1638)] 15:46:05.373225 run osmo-hlr_10.42.42.2(pid=1638): stdout: | (launched: 2022-12-13_15:46:01.582738) 15:46:05.425893 run osmo-hlr_10.42.42.2(pid=1638): stderr: | [0;m[1;31m20221213154601877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154601877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154601877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154601877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154601877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154601877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154601901 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154601916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154601916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154601928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:05.478885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1631): Terminating (SIGTERM) 15:46:05.521490 run iperf3-srv_10.42.42.10(pid=1632): Terminating (SIGTERM) 15:46:05.564075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1633): Terminating (SIGTERM) 15:46:05.606978 run iperf3-srv_10.42.42.10(pid=1634): Terminating (SIGTERM) 15:46:05.649421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1637): Terminating (SIGTERM) 15:46:05.692393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1640): Terminating (SIGTERM) 15:46:05.734840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1643): Terminating (SIGTERM) 15:46:05.777755 --- ParallelTerminationStrategy: PID 1631 died... 15:46:05.798026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1631): Terminated: ok {rc=0} 15:46:05.844761 --- ParallelTerminationStrategy: PID 1632 died... 15:46:05.864486 run iperf3-srv_10.42.42.10(pid=1632): Terminated {rc=256} 15:46:05.911226 --- ParallelTerminationStrategy: PID 1633 died... 15:46:05.931031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1633): Terminated: ok {rc=0} 15:46:05.977517 --- ParallelTerminationStrategy: PID 1634 died... 15:46:05.997344 run iperf3-srv_10.42.42.10(pid=1634): Terminated {rc=256} 15:46:06.043764 --- ParallelTerminationStrategy: PID 1637 died... 15:46:06.063667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1637): Terminated: ok {rc=0} 15:46:06.110434 --- ParallelTerminationStrategy: PID 1640 died... 15:46:06.130186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1640): Terminated: ok {rc=0} 15:46:06.176609 --- ParallelTerminationStrategy: PID 1643 died... 15:46:06.196321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1643): Terminated: ok {rc=0} 15:46:06.284627 bus /gobi_0: Setting Powered False 15:46:07.384806 bus /gobi_0: Setting Powered False 15:46:08.502810 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 15:46:09.655266 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:09.667529 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:46:09.732606 tst iperf3.py: using LAC 34617 15:46:09.864271 tst iperf3.py: using RAC 192 15:46:09.996894 tst iperf3.py: using CellId 34617 15:46:10.127852 tst iperf3.py: using BVCI 34618 15:46:10.250759 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:10.262254 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:10.273475 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:10.284660 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:10.295927 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:10.307133 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:10.318746 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:10.329933 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:10.341358 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:10.460197 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:46:10.675203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:10.995915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1645): Launched 15:46:11.277233 run iperf3-srv_10.42.42.10(pid=1646): Launched 15:46:11.398407 tst iperf3.py:8: start network... 15:46:11.611048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:12.102221 run create_hlr_db(pid=1647): Launched 15:46:12.223126 bus /gobi_6: Setting Powered False 15:46:13.286423 run create_hlr_db(pid=1647): Terminated: ok {rc=0} 15:46:13.728096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1649): Launched 15:46:14.047544 run osmo-hlr_10.42.42.2(pid=1650): Launched 15:46:14.170190 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:14.716643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1652): Launched 15:46:15.035930 run osmo-stp_10.42.42.5(pid=1653): Launched 15:46:15.158329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:15.704354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1655): Launched 15:46:15.830366 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:16.129691 run patchelf(pid=1656): Launched 15:46:16.337834 run osmo-stp_10.42.42.5(pid=1653): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1653)] 15:46:16.485224 run osmo-stp_10.42.42.5(pid=1653): stdout: | (launched: 2022-12-13_15:46:14.976560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:16.634955 run osmo-stp_10.42.42.5(pid=1653): stderr: | [0;m[38;5;43m20221213154615151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154615151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154615151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154615152 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154615152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154615152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154615152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:16.784890 run osmo-stp_10.42.42.5(pid=1653): stdout: | (launched: 2022-12-13_15:46:14.976560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:16.927971 run osmo-stp_10.42.42.5(pid=1653): stderr: | [0;m[38;5;43m20221213154615151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154615151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154615151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154615152 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154615152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154615152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154615152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:17.098429 run patchelf(pid=1656): Terminating (SIGINT) 15:46:17.290315 run patchelf(pid=1656): Terminated: ok {rc=0} 15:46:17.427184 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1653): Process ended prematurely: osmo-stp_10.42.42.5(pid=1653) [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1653)] [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 15:46:17.437895 tst iperf3.py:8: Test FAILED (7.8 sec) 15:46:17.466862 run osmo-hlr_10.42.42.2(pid=1650): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1650)] 15:46:17.518767 run osmo-hlr_10.42.42.2(pid=1650): stdout: | (launched: 2022-12-13_15:46:13.987721) 15:46:17.571595 run osmo-hlr_10.42.42.2(pid=1650): stderr: | [0;m[1;31m20221213154614167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154614167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154614167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154614167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154614167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154614167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154614178 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154614186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154614187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154614187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:17.624659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1645): Terminating (SIGTERM) 15:46:17.667644 run iperf3-srv_10.42.42.10(pid=1646): Terminating (SIGTERM) 15:46:17.710351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1649): Terminating (SIGTERM) 15:46:17.752919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1652): Terminating (SIGTERM) 15:46:17.795878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1655): Terminating (SIGTERM) 15:46:17.839289 --- ParallelTerminationStrategy: PID 1645 died... 15:46:17.859956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1645): Terminated: ok {rc=0} 15:46:17.907960 --- ParallelTerminationStrategy: PID 1646 died... 15:46:17.928199 run iperf3-srv_10.42.42.10(pid=1646): Terminated {rc=256} 15:46:17.975533 --- ParallelTerminationStrategy: PID 1649 died... 15:46:17.995815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1649): Terminated: ok {rc=0} 15:46:18.043307 --- ParallelTerminationStrategy: PID 1652 died... 15:46:18.063607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1652): Terminated: ok {rc=0} 15:46:18.110882 --- ParallelTerminationStrategy: PID 1655 died... 15:46:18.131101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1655): Terminated: ok {rc=0} 15:46:18.220086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 15:46:19.371360 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:19.383172 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:46:19.441172 tst iperf3m4.py: using LAC 34618 15:46:19.565496 tst iperf3m4.py: using RAC 193 15:46:19.698524 tst iperf3m4.py: using CellId 34618 15:46:19.832570 tst iperf3m4.py: using BVCI 34619 15:46:19.956303 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:19.968082 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:19.979550 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:19.990915 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:20.002382 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:20.013893 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:20.025657 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:20.037069 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:20.048637 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:20.175524 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:20.300078 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:20.422490 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:20.543337 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:46:20.757852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:21.078496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1657): Launched 15:46:21.357669 run iperf3-srv_10.42.42.10(pid=1658): Launched 15:46:21.476309 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:46:21.688432 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:22.008361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1659): Launched 15:46:22.288487 run iperf3-srv_10.42.42.10(pid=1660): Launched 15:46:22.409426 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:46:22.622345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:22.942459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1661): Launched 15:46:23.220638 run iperf3-srv_10.42.42.10(pid=1662): Launched 15:46:23.341355 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:46:23.553296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:23.872939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1663): Launched 15:46:24.152511 run iperf3-srv_10.42.42.10(pid=1664): Launched 15:46:24.273581 tst iperf3m4.py:8: start network... 15:46:24.486706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:24.980072 run create_hlr_db(pid=1665): Launched 15:46:25.102121 bus /gobi_6: Setting Powered False 15:46:26.164216 run create_hlr_db(pid=1665): Terminated: ok {rc=0} 15:46:26.627634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1667): Launched 15:46:26.967907 run osmo-hlr_10.42.42.2(pid=1668): Launched 15:46:27.096056 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:27.679974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1670): Launched 15:46:28.020816 run osmo-stp_10.42.42.5(pid=1671): Launched 15:46:28.151500 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:28.734266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1673): Launched 15:46:28.863602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:29.151854 run patchelf(pid=1674): Launched 15:46:29.340888 run osmo-stp_10.42.42.5(pid=1671): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1671)] 15:46:29.483294 run osmo-stp_10.42.42.5(pid=1671): stdout: | (launched: 2022-12-13_15:46:27.957655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:29.627287 run osmo-stp_10.42.42.5(pid=1671): stderr: | [0;m[38;5;43m20221213154628149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154628149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154628150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154628150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154628151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154628151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154628151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:29.771416 run osmo-stp_10.42.42.5(pid=1671): stdout: | (launched: 2022-12-13_15:46:27.957655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:29.909575 run osmo-stp_10.42.42.5(pid=1671): stderr: | [0;m[38;5;43m20221213154628149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154628149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154628150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154628150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154628151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154628151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154628151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:30.073043 run patchelf(pid=1674): Terminating (SIGINT) 15:46:30.261669 run patchelf(pid=1674): Terminated: ok {rc=0} 15:46:30.397553 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1671): Process ended prematurely: osmo-stp_10.42.42.5(pid=1671) [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1671)] [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 15:46:30.407850 tst iperf3m4.py:8: Test FAILED (11.1 sec) 15:46:30.436923 run osmo-hlr_10.42.42.2(pid=1668): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1668)] 15:46:30.487454 run osmo-hlr_10.42.42.2(pid=1668): stdout: | (launched: 2022-12-13_15:46:26.904417) 15:46:30.539509 run osmo-hlr_10.42.42.2(pid=1668): stderr: | [0;m[1;31m20221213154627104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154627104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154627104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154627104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154627104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154627104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154627117 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154627126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154627126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154627126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:30.591832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1657): Terminating (SIGTERM) 15:46:30.634861 run iperf3-srv_10.42.42.10(pid=1658): Terminating (SIGTERM) 15:46:30.677927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1659): Terminating (SIGTERM) 15:46:30.720734 run iperf3-srv_10.42.42.10(pid=1660): Terminating (SIGTERM) 15:46:30.763548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1661): Terminating (SIGTERM) 15:46:30.806322 run iperf3-srv_10.42.42.10(pid=1662): Terminating (SIGTERM) 15:46:30.864834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1663): Terminating (SIGTERM) 15:46:30.922348 run iperf3-srv_10.42.42.10(pid=1664): Terminating (SIGTERM) 15:46:30.968859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1667): Terminating (SIGTERM) 15:46:31.012771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1670): Terminating (SIGTERM) 15:46:31.056260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1673): Terminating (SIGTERM) 15:46:31.100058 --- ParallelTerminationStrategy: PID 1657 died... 15:46:31.120832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1657): Terminated: ok {rc=0} 15:46:31.175250 --- ParallelTerminationStrategy: PID 1658 died... 15:46:31.200104 run iperf3-srv_10.42.42.10(pid=1658): Terminated {rc=256} 15:46:31.248934 --- ParallelTerminationStrategy: PID 1659 died... 15:46:31.270000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1659): Terminated: ok {rc=0} 15:46:31.318875 --- ParallelTerminationStrategy: PID 1660 died... 15:46:31.339802 run iperf3-srv_10.42.42.10(pid=1660): Terminated {rc=256} 15:46:31.387716 --- ParallelTerminationStrategy: PID 1661 died... 15:46:31.408409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1661): Terminated: ok {rc=0} 15:46:31.456320 --- ParallelTerminationStrategy: PID 1662 died... 15:46:31.477009 run iperf3-srv_10.42.42.10(pid=1662): Terminated {rc=256} 15:46:31.524918 --- ParallelTerminationStrategy: PID 1663 died... 15:46:31.545748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1663): Terminated: ok {rc=0} 15:46:31.593548 --- ParallelTerminationStrategy: PID 1664 died... 15:46:31.614535 run iperf3-srv_10.42.42.10(pid=1664): Terminated {rc=256} 15:46:31.662194 --- ParallelTerminationStrategy: PID 1667 died... 15:46:31.682811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1667): Terminated: ok {rc=0} 15:46:31.731525 --- ParallelTerminationStrategy: PID 1670 died... 15:46:31.753181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1670): Terminated: ok {rc=0} 15:46:31.803307 --- ParallelTerminationStrategy: PID 1673 died... 15:46:31.823625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1673): Terminated: ok {rc=0} 15:46:31.915711 bus /gobi_4: Setting Powered False 15:46:33.017891 bus /gobi_4: Setting Powered False 15:46:34.136025 bus /gobi_1: Setting Powered False 15:46:35.234629 bus /gobi_1: Setting Powered False 15:46:36.352591 bus /gobi_0: Setting Powered False 15:46:37.449986 bus /gobi_0: Setting Powered False 15:46:38.568798 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 15:46:39.674628 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:39.686500 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:46:39.744267 tst ping.py: using LAC 34619 15:46:39.865997 tst ping.py: using RAC 194 15:46:39.990321 tst ping.py: using CellId 34619 15:46:40.113997 tst ping.py: using BVCI 34620 15:46:40.229295 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.240236 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.250989 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.262422 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.273653 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.284725 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.296161 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.307478 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:40.430619 tst ping.py:19: start network... 15:46:40.655601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:41.172283 run create_hlr_db(pid=1675): Launched 15:46:41.308512 bus /gobi_6: Setting Powered False 15:46:42.374754 run create_hlr_db(pid=1675): Terminated: ok {rc=0} 15:46:42.840676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1677): Launched 15:46:43.177448 run osmo-hlr_10.42.42.2(pid=1678): Launched 15:46:43.305512 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:43.887231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1680): Launched 15:46:44.222962 run osmo-stp_10.42.42.5(pid=1681): Launched 15:46:44.349890 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:44.926946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1683): Launched 15:46:45.055717 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:45.338209 run patchelf(pid=1684): Launched 15:46:45.523649 run osmo-stp_10.42.42.5(pid=1681): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1681)] 15:46:45.663671 run osmo-stp_10.42.42.5(pid=1681): stdout: | (launched: 2022-12-13_15:46:44.160133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:45.805785 run osmo-stp_10.42.42.5(pid=1681): stderr: | [0;m[38;5;43m20221213154644357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154644357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154644357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154644358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154644358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154644358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154644358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:45.983390 run osmo-stp_10.42.42.5(pid=1681): stdout: | (launched: 2022-12-13_15:46:44.160133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:46.122542 run osmo-stp_10.42.42.5(pid=1681): stderr: | [0;m[38;5;43m20221213154644357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154644357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154644357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154644358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154644358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154644358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154644358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:46.286120 run patchelf(pid=1684): Terminating (SIGINT) 15:46:46.474989 run patchelf(pid=1684): Terminated: ok {rc=0} 15:46:46.611573 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1681): Process ended prematurely: osmo-stp_10.42.42.5(pid=1681) [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1681)] [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 15:46:46.622340 tst ping.py:22: Test FAILED (6.9 sec) 15:46:46.652006 run osmo-hlr_10.42.42.2(pid=1678): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1678)] 15:46:46.703769 run osmo-hlr_10.42.42.2(pid=1678): stdout: | (launched: 2022-12-13_15:46:43.114898) 15:46:46.757418 run osmo-hlr_10.42.42.2(pid=1678): stderr: | [0;m[1;31m20221213154643318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154643318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154643318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154643318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154643318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154643318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154643331 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154643339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154643339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154643339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:46.811830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1677): Terminating (SIGTERM) 15:46:46.855418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1680): Terminating (SIGTERM) 15:46:46.900696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1683): Terminating (SIGTERM) 15:46:46.946346 --- ParallelTerminationStrategy: PID 1677 died... 15:46:46.967024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1677): Terminated: ok {rc=0} 15:46:47.015122 --- ParallelTerminationStrategy: PID 1680 died... 15:46:47.035652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1680): Terminated: ok {rc=0} 15:46:47.083060 --- ParallelTerminationStrategy: PID 1683 died... 15:46:47.103454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1683): Terminated: ok {rc=0} 15:46:47.192647 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 15:46:48.281563 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:48.293757 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:46:48.353662 tst ping_idle_ping.py: using LAC 34620 15:46:48.473788 tst ping_idle_ping.py: using RAC 195 15:46:48.595847 tst ping_idle_ping.py: using CellId 34620 15:46:48.715920 tst ping_idle_ping.py: using BVCI 34621 15:46:48.829238 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:48.840139 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:48.850795 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:48.861595 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:48.872528 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:48.883548 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:48.894839 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:48.905935 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:49.024894 tst ping_idle_ping.py:24: start network... 15:46:49.235786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:49.723044 run create_hlr_db(pid=1685): Launched 15:46:49.844726 bus /gobi_6: Setting Powered False 15:46:50.907435 run create_hlr_db(pid=1685): Terminated: ok {rc=0} 15:46:51.367347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1687): Launched 15:46:51.705328 run osmo-hlr_10.42.42.2(pid=1688): Launched 15:46:51.834845 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:52.412459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1690): Launched 15:46:52.748873 run osmo-stp_10.42.42.5(pid=1691): Launched 15:46:52.877315 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:53.454944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1693): Launched 15:46:53.582697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:53.867032 run patchelf(pid=1694): Launched 15:46:54.053957 run osmo-stp_10.42.42.5(pid=1691): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1691)] 15:46:54.195327 run osmo-stp_10.42.42.5(pid=1691): stdout: | (launched: 2022-12-13_15:46:52.686556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:54.338147 run osmo-stp_10.42.42.5(pid=1691): stderr: | [0;m[38;5;43m20221213154652885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154652885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154652885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154652886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154652886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154652886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154652886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:54.480849 run osmo-stp_10.42.42.5(pid=1691): stdout: | (launched: 2022-12-13_15:46:52.686556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:54.617029 run osmo-stp_10.42.42.5(pid=1691): stderr: | [0;m[38;5;43m20221213154652885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154652885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154652885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154652886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154652886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154652886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154652886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:54.778488 run patchelf(pid=1694): Terminating (SIGINT) 15:46:54.966143 run patchelf(pid=1694): Terminated: ok {rc=0} 15:46:55.100277 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1691): Process ended prematurely: osmo-stp_10.42.42.5(pid=1691) [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1691)] [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 15:46:55.110110 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 15:46:55.138426 run osmo-hlr_10.42.42.2(pid=1688): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1688)] 15:46:55.189096 run osmo-hlr_10.42.42.2(pid=1688): stdout: | (launched: 2022-12-13_15:46:51.642869) 15:46:55.241639 run osmo-hlr_10.42.42.2(pid=1688): stderr: | [0;m[1;31m20221213154651842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154651842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154651842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154651842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154651842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154651842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154651855 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154651867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154651867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154651867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:55.294523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1687): Terminating (SIGTERM) 15:46:55.337486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1690): Terminating (SIGTERM) 15:46:55.380833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1693): Terminating (SIGTERM) 15:46:55.424099 --- ParallelTerminationStrategy: PID 1687 died... 15:46:55.444784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1687): Terminated: ok {rc=0} 15:46:55.492443 --- ParallelTerminationStrategy: PID 1690 died... 15:46:55.512536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1690): Terminated: ok {rc=0} 15:46:55.560288 --- ParallelTerminationStrategy: PID 1693 died... 15:46:55.580653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1693): Terminated: ok {rc=0} 15:46:55.669395 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:46:56.962198 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:46:56.969495 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:46:56.991254 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 15:46:57.031587 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 15:46:57.123576 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:46:57.145733 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 15:46:57.185768 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 15:46:57.780884 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 15:46:57.835636 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:57.847253 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:46:57.928266 tst cs_paging_gprs_active.py: using LAC 34621 15:46:58.063932 tst cs_paging_gprs_active.py: using RAC 196 15:46:58.194642 tst cs_paging_gprs_active.py: using CellId 34621 15:46:58.327111 tst cs_paging_gprs_active.py: using BVCI 34622 15:46:58.451465 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:58.463030 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:58.474463 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:58.485896 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:58.497287 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:58.508651 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:58.520196 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:58.531509 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:58.543036 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:58.664798 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:58.790278 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:46:59.021416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:59.362891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1698): Launched 15:46:59.659005 run iperf3-srv_10.42.42.10(pid=1699): Launched 15:46:59.787988 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:47:00.017419 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:47:00.359112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1700): Launched 15:47:00.655385 run iperf3-srv_10.42.42.10(pid=1701): Launched 15:47:00.782617 tst cs_paging_gprs_active.py:38: start network... 15:47:01.017460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:01.554372 run create_hlr_db(pid=1702): Launched 15:47:01.714942 bus /gobi_6: Setting Powered False 15:47:02.777689 run create_hlr_db(pid=1702): Terminated: ok {rc=0} 15:47:03.224250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1704): Launched 15:47:03.544185 run osmo-hlr_10.42.42.2(pid=1705): Launched 15:47:03.668186 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:04.215358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1707): Launched 15:47:04.535869 run osmo-stp_10.42.42.5(pid=1708): Launched 15:47:04.658869 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:47:05.207451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1710): Launched 15:47:05.330658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:47:05.600566 run patchelf(pid=1711): Launched 15:47:05.778605 run osmo-stp_10.42.42.5(pid=1708): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1708)] 15:47:05.913149 run osmo-stp_10.42.42.5(pid=1708): stdout: | (launched: 2022-12-13_15:47:04.476380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:06.048772 run osmo-stp_10.42.42.5(pid=1708): stderr: | [0;m[38;5;43m20221213154704649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154704650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154704650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154704650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154704651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154704651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154704651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:06.184771 run osmo-stp_10.42.42.5(pid=1708): stdout: | (launched: 2022-12-13_15:47:04.476380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:06.314405 run osmo-stp_10.42.42.5(pid=1708): stderr: | [0;m[38;5;43m20221213154704649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154704650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154704650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154704650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154704651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154704651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154704651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:06.467817 run patchelf(pid=1711): Terminating (SIGINT) 15:47:06.646551 run patchelf(pid=1711): Terminated: ok {rc=0} 15:47:06.774774 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1708): Process ended prematurely: osmo-stp_10.42.42.5(pid=1708) [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1708)] [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 15:47:06.784442 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 15:47:06.811926 run osmo-hlr_10.42.42.2(pid=1705): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1705)] 15:47:06.861010 run osmo-hlr_10.42.42.2(pid=1705): stdout: | (launched: 2022-12-13_15:47:03.484379) 15:47:06.911628 run osmo-hlr_10.42.42.2(pid=1705): stderr: | [0;m[1;31m20221213154703665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154703665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154703665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154703665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154703665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154703665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154703679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154703687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154703687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154703687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:06.962798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1698): Terminating (SIGTERM) 15:47:07.004239 run iperf3-srv_10.42.42.10(pid=1699): Terminating (SIGTERM) 15:47:07.044935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1700): Terminating (SIGTERM) 15:47:07.085906 run iperf3-srv_10.42.42.10(pid=1701): Terminating (SIGTERM) 15:47:07.126631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1704): Terminating (SIGTERM) 15:47:07.167452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1707): Terminating (SIGTERM) 15:47:07.208021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1710): Terminating (SIGTERM) 15:47:07.248935 --- ParallelTerminationStrategy: PID 1698 died... 15:47:07.268772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1698): Terminated: ok {rc=0} 15:47:07.313783 --- ParallelTerminationStrategy: PID 1699 died... 15:47:07.332824 run iperf3-srv_10.42.42.10(pid=1699): Terminated {rc=256} 15:47:07.377821 --- ParallelTerminationStrategy: PID 1700 died... 15:47:07.397226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1700): Terminated: ok {rc=0} 15:47:07.442042 --- ParallelTerminationStrategy: PID 1701 died... 15:47:07.461315 run iperf3-srv_10.42.42.10(pid=1701): Terminated {rc=256} 15:47:07.505963 --- ParallelTerminationStrategy: PID 1704 died... 15:47:07.525294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1704): Terminated: ok {rc=0} 15:47:07.570027 --- ParallelTerminationStrategy: PID 1707 died... 15:47:07.589350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1707): Terminated: ok {rc=0} 15:47:07.634051 --- ParallelTerminationStrategy: PID 1710 died... 15:47:07.653266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1710): Terminated: ok {rc=0} 15:47:07.738071 bus /gobi_0: Setting Powered False 15:47:08.837534 bus /gobi_0: Setting Powered False 15:47:09.955635 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 15:47:11.107489 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:11.119663 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:47:11.181407 tst iperf3.py: using LAC 34622 15:47:11.313351 tst iperf3.py: using RAC 197 15:47:11.445073 tst iperf3.py: using CellId 34622 15:47:11.581264 tst iperf3.py: using BVCI 34623 15:47:11.705093 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:11.716590 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:11.727879 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:11.739237 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:11.750450 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:11.761742 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:11.773140 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:11.784268 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:11.795741 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:11.917706 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:47:12.146727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:47:12.488301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1712): Launched 15:47:12.786682 run iperf3-srv_10.42.42.10(pid=1713): Launched 15:47:12.915578 tst iperf3.py:8: start network... 15:47:13.144906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:13.672519 run create_hlr_db(pid=1714): Launched 15:47:13.810490 bus /gobi_6: Setting Powered False 15:47:14.876703 run create_hlr_db(pid=1714): Terminated: ok {rc=0} 15:47:15.349069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1716): Launched 15:47:15.690811 run osmo-hlr_10.42.42.2(pid=1717): Launched 15:47:15.819417 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:16.566351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1719): Launched 15:47:16.896821 run osmo-stp_10.42.42.5(pid=1720): Launched 15:47:17.153335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:47:17.849327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1722): Launched 15:47:17.973076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:47:18.243667 run patchelf(pid=1723): Launched 15:47:18.422166 run osmo-stp_10.42.42.5(pid=1720): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1720)] 15:47:18.556206 run osmo-stp_10.42.42.5(pid=1720): stdout: | (launched: 2022-12-13_15:47:16.833926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:18.692792 run osmo-stp_10.42.42.5(pid=1720): stderr: | [0;m[38;5;43m20221213154717164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154717165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154717165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154717165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154717166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154717166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154717166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:18.829855 run osmo-stp_10.42.42.5(pid=1720): stdout: | (launched: 2022-12-13_15:47:16.833926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:18.960287 run osmo-stp_10.42.42.5(pid=1720): stderr: | [0;m[38;5;43m20221213154717164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154717165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154717165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154717165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154717166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154717166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154717166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:19.115126 run patchelf(pid=1723): Terminating (SIGINT) 15:47:19.294490 run patchelf(pid=1723): Terminated: ok {rc=0} 15:47:19.423882 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1720): Process ended prematurely: osmo-stp_10.42.42.5(pid=1720) [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1720)] [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 15:47:19.433740 tst iperf3.py:8: Test FAILED (8.4 sec) 15:47:19.461100 run osmo-hlr_10.42.42.2(pid=1717): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1717)] 15:47:19.510227 run osmo-hlr_10.42.42.2(pid=1717): stdout: | (launched: 2022-12-13_15:47:15.627351) 15:47:19.560911 run osmo-hlr_10.42.42.2(pid=1717): stderr: | [0;m[1;31m20221213154715844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154715844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154715844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154715844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154715844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154715844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154715865 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154715888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154715888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154715897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:19.611656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1712): Terminating (SIGTERM) 15:47:19.652483 run iperf3-srv_10.42.42.10(pid=1713): Terminating (SIGTERM) 15:47:19.693460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1716): Terminating (SIGTERM) 15:47:19.734403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1719): Terminating (SIGTERM) 15:47:19.774936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1722): Terminating (SIGTERM) 15:47:19.816055 --- ParallelTerminationStrategy: PID 1712 died... 15:47:19.835927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1712): Terminated: ok {rc=0} 15:47:19.880776 --- ParallelTerminationStrategy: PID 1713 died... 15:47:19.899929 run iperf3-srv_10.42.42.10(pid=1713): Terminated {rc=256} 15:47:19.944932 --- ParallelTerminationStrategy: PID 1716 died... 15:47:19.964251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1716): Terminated: ok {rc=0} 15:47:20.008934 --- ParallelTerminationStrategy: PID 1719 died... 15:47:20.028191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1719): Terminated: ok {rc=0} 15:47:20.072820 --- ParallelTerminationStrategy: PID 1722 died... 15:47:20.092807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1722): Terminated: ok {rc=0} 15:47:20.180808 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 15:47:21.331487 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:21.343217 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:47:21.401738 tst iperf3m4.py: using LAC 34623 15:47:21.528307 tst iperf3m4.py: using RAC 198 15:47:21.654818 tst iperf3m4.py: using CellId 34623 15:47:21.781915 tst iperf3m4.py: using BVCI 34624 15:47:21.899677 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:21.910764 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:21.921664 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:21.932385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:21.943451 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:21.954712 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:21.965937 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:21.976866 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:21.988145 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:22.107528 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:22.233898 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:22.353839 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:22.477736 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:47:22.706876 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:47:23.049427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1724): Launched 15:47:23.347945 run iperf3-srv_10.42.42.10(pid=1725): Launched 15:47:23.475184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:47:23.703315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:47:24.045070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1726): Launched 15:47:24.342376 run iperf3-srv_10.42.42.10(pid=1727): Launched 15:47:24.470617 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:47:24.697699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:47:25.038284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1728): Launched 15:47:25.335964 run iperf3-srv_10.42.42.10(pid=1729): Launched 15:47:25.463216 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:47:25.691664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:47:26.033569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1730): Launched 15:47:26.330454 run iperf3-srv_10.42.42.10(pid=1731): Launched 15:47:26.457959 tst iperf3m4.py:8: start network... 15:47:26.684793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:27.211460 run create_hlr_db(pid=1732): Launched 15:47:27.349518 bus /gobi_6: Setting Powered False 15:47:28.415601 run create_hlr_db(pid=1732): Terminated: ok {rc=0} 15:47:28.867727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1734): Launched 15:47:29.187863 run osmo-hlr_10.42.42.2(pid=1735): Launched 15:47:29.311970 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:29.865627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1737): Launched 15:47:30.185623 run osmo-stp_10.42.42.5(pid=1738): Launched 15:47:30.307341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:47:30.867508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1740): Launched 15:47:31.017912 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:47:31.394533 run patchelf(pid=1741): Launched 15:47:31.592069 run osmo-stp_10.42.42.5(pid=1738): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1738)] 15:47:31.731575 run osmo-stp_10.42.42.5(pid=1738): stdout: | (launched: 2022-12-13_15:47:30.125673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:31.875182 run osmo-stp_10.42.42.5(pid=1738): stderr: | [0;m[38;5;43m20221213154730298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154730298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154730298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154730298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154730299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154730299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154730299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:32.016377 run osmo-stp_10.42.42.5(pid=1738): stdout: | (launched: 2022-12-13_15:47:30.125673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:32.152122 run osmo-stp_10.42.42.5(pid=1738): stderr: | [0;m[38;5;43m20221213154730298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154730298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154730298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154730298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154730299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154730299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154730299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:32.310711 run patchelf(pid=1741): Terminating (SIGINT) 15:47:32.489816 run patchelf(pid=1741): Terminated: ok {rc=0} 15:47:32.618816 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1738): Process ended prematurely: osmo-stp_10.42.42.5(pid=1738) [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1738)] [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 15:47:32.628458 tst iperf3m4.py:8: Test FAILED (11.3 sec) 15:47:32.656539 run osmo-hlr_10.42.42.2(pid=1735): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1735)] 15:47:32.706409 run osmo-hlr_10.42.42.2(pid=1735): stdout: | (launched: 2022-12-13_15:47:29.127810) 15:47:32.757568 run osmo-hlr_10.42.42.2(pid=1735): stderr: | [0;m[1;31m20221213154729307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154729307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154729307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154729307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154729307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154729307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154729320 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154729328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154729329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154729329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:32.809099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1724): Terminating (SIGTERM) 15:47:32.850237 run iperf3-srv_10.42.42.10(pid=1725): Terminating (SIGTERM) 15:47:32.891462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1726): Terminating (SIGTERM) 15:47:32.932504 run iperf3-srv_10.42.42.10(pid=1727): Terminating (SIGTERM) 15:47:32.973636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1728): Terminating (SIGTERM) 15:47:33.014492 run iperf3-srv_10.42.42.10(pid=1729): Terminating (SIGTERM) 15:47:33.055302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1730): Terminating (SIGTERM) 15:47:33.096065 run iperf3-srv_10.42.42.10(pid=1731): Terminating (SIGTERM) 15:47:33.137356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1734): Terminating (SIGTERM) 15:47:33.178289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1737): Terminating (SIGTERM) 15:47:33.219224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1740): Terminating (SIGTERM) 15:47:33.260375 --- ParallelTerminationStrategy: PID 1724 died... 15:47:33.279832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1724): Terminated: ok {rc=0} 15:47:33.325433 --- ParallelTerminationStrategy: PID 1725 died... 15:47:33.344823 run iperf3-srv_10.42.42.10(pid=1725): Terminated {rc=256} 15:47:33.390188 --- ParallelTerminationStrategy: PID 1726 died... 15:47:33.409617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1726): Terminated: ok {rc=0} 15:47:33.454867 --- ParallelTerminationStrategy: PID 1727 died... 15:47:33.474196 run iperf3-srv_10.42.42.10(pid=1727): Terminated {rc=256} 15:47:33.519308 --- ParallelTerminationStrategy: PID 1728 died... 15:47:33.538684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1728): Terminated: ok {rc=0} 15:47:33.583873 --- ParallelTerminationStrategy: PID 1729 died... 15:47:33.603251 run iperf3-srv_10.42.42.10(pid=1729): Terminated {rc=256} 15:47:33.648642 --- ParallelTerminationStrategy: PID 1730 died... 15:47:33.668146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1730): Terminated: ok {rc=0} 15:47:33.713331 --- ParallelTerminationStrategy: PID 1731 died... 15:47:33.732845 run iperf3-srv_10.42.42.10(pid=1731): Terminated {rc=256} 15:47:33.778270 --- ParallelTerminationStrategy: PID 1734 died... 15:47:33.797846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1734): Terminated: ok {rc=0} 15:47:33.843169 --- ParallelTerminationStrategy: PID 1737 died... 15:47:33.862529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1737): Terminated: ok {rc=0} 15:47:33.907948 --- ParallelTerminationStrategy: PID 1740 died... 15:47:33.927275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1740): Terminated: ok {rc=0} 15:47:34.015463 bus /gobi_4: Setting Powered False 15:47:35.116101 bus /gobi_4: Setting Powered False 15:47:36.231684 bus /gobi_1: Setting Powered False 15:47:37.327561 bus /gobi_1: Setting Powered False 15:47:38.442769 bus /gobi_0: Setting Powered False 15:47:39.541952 bus /gobi_0: Setting Powered False 15:47:40.661616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 15:47:41.764868 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:41.776593 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:47:41.835324 tst ping.py: using LAC 34624 15:47:41.957900 tst ping.py: using RAC 199 15:47:42.081439 tst ping.py: using CellId 34624 15:47:42.204096 tst ping.py: using BVCI 34625 15:47:42.326855 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:42.338431 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:42.349863 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:42.361158 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:42.372369 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:42.383691 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:42.395239 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:42.406498 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:42.524749 tst ping.py:19: start network... 15:47:42.749359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:43.266517 run create_hlr_db(pid=1742): Launched 15:47:43.393268 bus /gobi_6: Setting Powered False 15:47:44.459429 run create_hlr_db(pid=1742): Terminated: ok {rc=0} 15:47:44.922610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1744): Launched 15:47:45.259322 run osmo-hlr_10.42.42.2(pid=1745): Launched 15:47:45.388280 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:45.981816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1747): Launched 15:47:46.324669 run osmo-stp_10.42.42.5(pid=1748): Launched 15:47:46.713387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:47:47.471109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1750): Launched 15:47:47.599673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:47:47.882729 run patchelf(pid=1751): Launched 15:47:48.069933 run osmo-stp_10.42.42.5(pid=1748): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1748)] 15:47:48.210359 run osmo-stp_10.42.42.5(pid=1748): stdout: | (launched: 2022-12-13_15:47:46.260460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:48.353445 run osmo-stp_10.42.42.5(pid=1748): stderr: | [0;m[38;5;43m20221213154746633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154746633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154746634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154746636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154746637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154746637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154746637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:48.496454 run osmo-stp_10.42.42.5(pid=1748): stdout: | (launched: 2022-12-13_15:47:46.260460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:48.632750 run osmo-stp_10.42.42.5(pid=1748): stderr: | [0;m[38;5;43m20221213154746633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154746633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154746634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154746636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154746637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154746637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154746637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:48.794372 run patchelf(pid=1751): Terminating (SIGINT) 15:47:48.981639 run patchelf(pid=1751): Terminated: ok {rc=0} 15:47:49.116807 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1748): Process ended prematurely: osmo-stp_10.42.42.5(pid=1748) [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1748)] [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 15:47:49.126895 tst ping.py:22: Test FAILED (7.4 sec) 15:47:49.155485 run osmo-hlr_10.42.42.2(pid=1745): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1745)] 15:47:49.207338 run osmo-hlr_10.42.42.2(pid=1745): stdout: | (launched: 2022-12-13_15:47:45.196064) 15:47:49.260854 run osmo-hlr_10.42.42.2(pid=1745): stderr: | [0;m[1;31m20221213154745400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154745401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154745401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154745401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154745401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154745401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154745413 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154745421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154745422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154745422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:49.314537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1744): Terminating (SIGTERM) 15:47:49.357332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1747): Terminating (SIGTERM) 15:47:49.400679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1750): Terminating (SIGTERM) 15:47:49.443829 --- ParallelTerminationStrategy: PID 1744 died... 15:47:49.464686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1744): Terminated: ok {rc=0} 15:47:49.511977 --- ParallelTerminationStrategy: PID 1747 died... 15:47:49.532124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1747): Terminated: ok {rc=0} 15:47:49.579547 --- ParallelTerminationStrategy: PID 1750 died... 15:47:49.599869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1750): Terminated: ok {rc=0} 15:47:49.689407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 15:47:50.777676 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:50.789535 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:47:50.848321 tst ping_idle_ping.py: using LAC 34625 15:47:50.972183 tst ping_idle_ping.py: using RAC 200 15:47:51.095746 tst ping_idle_ping.py: using CellId 34625 15:47:51.220568 tst ping_idle_ping.py: using BVCI 34626 15:47:51.335414 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:51.346585 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:51.357442 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:51.368151 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:51.378905 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:51.389809 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:51.400701 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:51.411467 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:51.529323 tst ping_idle_ping.py:24: start network... 15:47:51.737638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:52.223406 run create_hlr_db(pid=1752): Launched 15:47:52.352843 bus /gobi_6: Setting Powered False 15:47:53.415245 run create_hlr_db(pid=1752): Terminated: ok {rc=0} 15:47:53.852047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1754): Launched 15:47:54.168052 run osmo-hlr_10.42.42.2(pid=1755): Launched 15:47:54.289064 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:54.830764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1757): Launched 15:47:55.145845 run osmo-stp_10.42.42.5(pid=1758): Launched 15:47:55.264484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:47:55.804502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1760): Launched 15:47:55.926268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:47:56.191899 run patchelf(pid=1761): Launched 15:47:56.366538 run osmo-stp_10.42.42.5(pid=1758): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1758)] 15:47:56.498782 run osmo-stp_10.42.42.5(pid=1758): stdout: | (launched: 2022-12-13_15:47:55.086804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:56.632779 run osmo-stp_10.42.42.5(pid=1758): stderr: | [0;m[38;5;43m20221213154755263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154755263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154755264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154755264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154755265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154755265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154755265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:56.767162 run osmo-stp_10.42.42.5(pid=1758): stdout: | (launched: 2022-12-13_15:47:55.086804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:56.894714 run osmo-stp_10.42.42.5(pid=1758): stderr: | [0;m[38;5;43m20221213154755263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154755263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154755264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154755264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154755265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154755265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154755265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:57.046070 run patchelf(pid=1761): Terminating (SIGINT) 15:47:57.221182 run patchelf(pid=1761): Terminated: ok {rc=0} 15:47:57.347591 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1758): Process ended prematurely: osmo-stp_10.42.42.5(pid=1758) [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1758)] [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 15:47:57.357239 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 15:47:57.384298 run osmo-hlr_10.42.42.2(pid=1755): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1755)] 15:47:57.432568 run osmo-hlr_10.42.42.2(pid=1755): stdout: | (launched: 2022-12-13_15:47:54.108709) 15:47:57.482950 run osmo-hlr_10.42.42.2(pid=1755): stderr: | [0;m[1;31m20221213154754289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154754289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154754289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154754290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154754290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154754290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154754302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154754310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154754310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154754311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:57.534155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1754): Terminating (SIGTERM) 15:47:57.574798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1757): Terminating (SIGTERM) 15:47:57.615382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1760): Terminating (SIGTERM) 15:47:57.656179 --- ParallelTerminationStrategy: PID 1754 died... 15:47:57.675839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1754): Terminated: ok {rc=0} 15:47:57.720631 --- ParallelTerminationStrategy: PID 1757 died... 15:47:57.739816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1757): Terminated: ok {rc=0} 15:47:57.784628 --- ParallelTerminationStrategy: PID 1760 died... 15:47:57.803887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1760): Terminated: ok {rc=0} 15:47:57.890882 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:47:59.184107 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:59.191412 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:47:59.213113 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 15:47:59.250042 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:47:59.305594 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:47:59.327376 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 15:47:59.363693 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:47:59.922152 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 15:47:59.927505 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:47:59.939563 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:47:59.998501 tst switch_tch_pdch.py: using LAC 34626 15:48:00.130703 tst switch_tch_pdch.py: using RAC 201 15:48:00.260202 tst switch_tch_pdch.py: using CellId 34626 15:48:00.389796 tst switch_tch_pdch.py: using BVCI 34627 15:48:00.511998 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:48:00.523932 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:48:00.535501 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:48:00.547143 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:48:00.559167 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:48:00.571139 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:48:00.583202 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:48:00.595169 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:48:00.714905 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:48:00.843610 tst switch_tch_pdch.py:51: start network... 15:48:01.062574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:01.558087 run create_hlr_db(pid=1768): Launched 15:48:01.722509 bus /gobi_6: Setting Powered False 15:48:02.787593 run create_hlr_db(pid=1768): Terminated: ok {rc=0} 15:48:03.257395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1770): Launched 15:48:03.570261 run osmo-hlr_10.42.42.2(pid=1771): Launched 15:48:03.689707 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:04.226882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1773): Launched 15:48:04.539235 run osmo-stp_10.42.42.5(pid=1774): Launched 15:48:04.658791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:48:05.193602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1776): Launched 15:48:05.313158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:48:05.576774 run patchelf(pid=1777): Launched 15:48:05.748595 run osmo-stp_10.42.42.5(pid=1774): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1774)] 15:48:05.879319 run osmo-stp_10.42.42.5(pid=1774): stdout: | (launched: 2022-12-13_15:48:04.480213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:06.012258 run osmo-stp_10.42.42.5(pid=1774): stderr: | [0;m[38;5;43m20221213154804654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154804654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154804654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154804655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154804655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154804655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154804655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:06.145109 run osmo-stp_10.42.42.5(pid=1774): stdout: | (launched: 2022-12-13_15:48:04.480213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:06.271382 run osmo-stp_10.42.42.5(pid=1774): stderr: | [0;m[38;5;43m20221213154804654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154804654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154804654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154804655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154804655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154804655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154804655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:06.421340 run patchelf(pid=1777): Terminating (SIGINT) 15:48:06.595495 run patchelf(pid=1777): Terminated: ok {rc=0} 15:48:06.721156 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1774): Process ended prematurely: osmo-stp_10.42.42.5(pid=1774) [trial-2391↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1774)] [trial-2391↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 15:48:06.730101 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 15:48:06.756781 run osmo-hlr_10.42.42.2(pid=1771): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1771)] 15:48:06.805114 run osmo-hlr_10.42.42.2(pid=1771): stdout: | (launched: 2022-12-13_15:48:03.511546) 15:48:06.854730 run osmo-hlr_10.42.42.2(pid=1771): stderr: | [0;m[1;31m20221213154803691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154803691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154803691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154803691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154803691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154803691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154803703 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154803714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154803714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154803714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:06.905171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1770): Terminating (SIGTERM) 15:48:06.945467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1773): Terminating (SIGTERM) 15:48:06.985823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1776): Terminating (SIGTERM) 15:48:07.026164 --- ParallelTerminationStrategy: PID 1770 died... 15:48:07.045591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1770): Terminated: ok {rc=0} 15:48:07.089812 --- ParallelTerminationStrategy: PID 1773 died... 15:48:07.108554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1773): Terminated: ok {rc=0} 15:48:07.152444 --- ParallelTerminationStrategy: PID 1776 died... 15:48:07.171287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1776): Terminated: ok {rc=0} 15:48:07.255771 bus /gobi_0: Setting Powered False 15:48:08.355162 bus /gobi_0: Setting Powered False 15:48:09.472941 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 15:48:10.710831 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:10.716682 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 15:48:10.737524 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 15:48:10.771972 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 15:48:10.824774 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 15:48:10.846802 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 15:48:10.881452 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 15:48:11.439307 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 15:48:11.444766 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:11.456502 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 15:48:11.515510 tst switch_tch_pdch.py: using LAC 34627 15:48:11.646675 tst switch_tch_pdch.py: using RAC 202 15:48:11.778654 tst switch_tch_pdch.py: using CellId 34627 15:48:11.909345 tst switch_tch_pdch.py: using BVCI 34628 15:48:12.031953 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:12.043580 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:12.054980 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:12.066416 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:12.078042 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:12.089608 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:12.101462 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:12.113144 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:48:12.232574 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:48:12.356091 tst switch_tch_pdch.py:51: start network... 15:48:12.580623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:13.068570 run create_hlr_db(pid=1782): Launched 15:48:13.196807 bus /gobi_6: Setting Powered False 15:48:14.259306 run create_hlr_db(pid=1782): Terminated: ok {rc=0} 15:48:14.668771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1784): Launched 15:48:14.983532 run osmo-hlr_10.42.42.2(pid=1785): Launched 15:48:15.104712 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:15.615200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1787): Launched 15:48:15.941661 run osmo-stp_10.42.42.5(pid=1788): Launched 15:48:16.124077 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:48:16.830156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1790): Launched 15:48:16.962323 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:48:17.231192 run patchelf(pid=1791): Launched 15:48:17.412521 run osmo-stp_10.42.42.5(pid=1788): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1788)] 15:48:17.544828 run osmo-stp_10.42.42.5(pid=1788): stdout: | (launched: 2022-12-13_15:48:15.874559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:17.678368 run osmo-stp_10.42.42.5(pid=1788): stderr: | [0;m[38;5;43m20221213154816241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154816241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154816242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154816244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154816247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154816247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154816248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:17.811570 run osmo-stp_10.42.42.5(pid=1788): stdout: | (launched: 2022-12-13_15:48:15.874559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:17.937907 run osmo-stp_10.42.42.5(pid=1788): stderr: | [0;m[38;5;43m20221213154816241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154816241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154816242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154816244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154816247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154816247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154816248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:18.088001 run patchelf(pid=1791): Terminating (SIGINT) 15:48:18.261838 run patchelf(pid=1791): Terminated: ok {rc=0} 15:48:18.387161 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1788): Process ended prematurely: osmo-stp_10.42.42.5(pid=1788) [trial-2391↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1788)] [trial-2391↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 15:48:18.396130 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 15:48:18.423293 run osmo-hlr_10.42.42.2(pid=1785): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1785)] 15:48:18.471419 run osmo-hlr_10.42.42.2(pid=1785): stdout: | (launched: 2022-12-13_15:48:14.924197) 15:48:18.521292 run osmo-hlr_10.42.42.2(pid=1785): stderr: | [0;m[1;31m20221213154815100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154815100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154815100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154815100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154815100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154815100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154815112 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154815122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154815122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154815122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:18.571189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1784): Terminating (SIGTERM) 15:48:18.611446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1787): Terminating (SIGTERM) 15:48:18.651531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1790): Terminating (SIGTERM) 15:48:18.691963 --- ParallelTerminationStrategy: PID 1784 died... 15:48:18.711323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1784): Terminated: ok {rc=0} 15:48:18.755599 --- ParallelTerminationStrategy: PID 1787 died... 15:48:18.774597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1787): Terminated: ok {rc=0} 15:48:18.819221 --- ParallelTerminationStrategy: PID 1790 died... 15:48:18.838272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1790): Terminated: ok {rc=0} 15:48:18.925545 bus /gobi_0: Setting Powered False 15:48:20.027843 bus /gobi_0: Setting Powered False 15:48:21.144854 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_sms:oc2g --------------------------------------------------------------------- 15:48:22.384691 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:22.388542 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 15:48:22.409105 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 15:48:22.415720 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 15:48:22.467865 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 15:48:22.488435 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 15:48:22.495038 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 15:48:23.031962 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 15:48:23.037234 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 15:48:23.048032 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 15:48:23.081629 tst mo_mt_sms.py: using LAC 34628 15:48:23.211918 tst mo_mt_sms.py: using RAC 203 15:48:23.342797 tst mo_mt_sms.py: using CellId 34628 15:48:23.475253 tst mo_mt_sms.py: using BVCI 34629 15:48:23.589664 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 15:48:23.710810 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 15:48:23.828688 tst mo_mt_sms.py:9: start nitb and bts... 15:48:24.038563 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:48:24.672771 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1795): Launched 15:48:24.987000 run osmo-nitb_10.42.42.2(pid=1796): Launched 15:48:25.159880 run osmo-nitb_10.42.42.2(pid=1796): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1796)] 15:48:25.299237 run osmo-nitb_10.42.42.2(pid=1796): stdout: | (launched: 2022-12-13_15:48:24.927690) 15:48:25.440129 run osmo-nitb_10.42.42.2(pid=1796): stderr: | (launched: 2022-12-13_15:48:24.974242) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:48:25.581389 run osmo-nitb_10.42.42.2(pid=1796): stdout: | (launched: 2022-12-13_15:48:24.927690) 15:48:25.716210 run osmo-nitb_10.42.42.2(pid=1796): stderr: | (launched: 2022-12-13_15:48:24.974242) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1796): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1796) [trial-2391↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1796)] 15:48:26.104522 tst osmo-nitb_10.42.42.2(pid=1796): stdout: | (launched: 2022-12-13_15:48:24.927690) 15:48:26.229907 tst osmo-nitb_10.42.42.2(pid=1796): stderr: | (launched: 2022-12-13_15:48:24.974242) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:48:26.377286 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1796): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1796) [trial-2391↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1796)] [trial-2391↪nitb_sms:oc2g↪mo_mt_sms.py:11] 15:48:26.386060 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 15:48:26.392887 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1795): Terminating (SIGTERM) 15:48:26.602109 --- ParallelTerminationStrategy: PID 1795 died... 15:48:26.623440 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1795): Terminated: ok {rc=0} 15:48:26.711659 bus /sierra_3: Setting Powered False 15:48:27.812143 bus /sierra_3: Setting Powered False 15:48:28.928414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 sms:oc2g --------------------------------------------------------------------- 15:48:30.109571 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:30.113825 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 15:48:30.134814 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 15:48:30.161526 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 15:48:30.213179 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 15:48:30.234225 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 15:48:30.260928 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 15:48:30.813043 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 sms:oc2g mo_mt_sms.py ---------------------------------------------- 15:48:30.818527 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:48:30.832809 tst sms:oc2g: Using 1 x bts (candidates: 1) 15:48:30.891386 tst mo_mt_sms.py: using LAC 34629 15:48:31.019157 tst mo_mt_sms.py: using RAC 204 15:48:31.188122 tst mo_mt_sms.py: using CellId 34629 15:48:31.361652 tst mo_mt_sms.py: using BVCI 34630 15:48:31.499143 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:48:31.510783 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:48:31.521998 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:48:31.533612 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:48:31.545486 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:48:31.556682 tst sms:oc2g: Using 1 x modem (candidates: 2) 15:48:31.678067 tst sms:oc2g: Using 1 x modem (candidates: 2) 15:48:31.793981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:32.362089 run create_hlr_db(pid=1800): Launched 15:48:32.498571 bus /sierra_2: Setting Powered False 15:48:33.563619 run create_hlr_db(pid=1800): Terminated: ok {rc=0} 15:48:34.027282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1802): Launched 15:48:34.362254 run osmo-hlr_10.42.42.2(pid=1803): Launched 15:48:34.489518 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:35.065954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1805): Launched 15:48:35.401335 run osmo-stp_10.42.42.5(pid=1806): Launched 15:48:35.529392 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:36.131513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1808): Launched 15:48:36.466768 run osmo-msc_10.42.42.6(pid=1809): Launched 15:48:36.654219 run osmo-stp_10.42.42.5(pid=1806): ERR: Terminated: ERROR {rc=1} [trial-2391↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1806)] 15:48:36.794435 run osmo-stp_10.42.42.5(pid=1806): stdout: | (launched: 2022-12-13_15:48:35.338930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:36.935380 run osmo-stp_10.42.42.5(pid=1806): stderr: | [0;m[38;5;43m20221213154835530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154835530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154835530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154835531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154835531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154835531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154835531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:37.074141 run osmo-stp_10.42.42.5(pid=1806): stdout: | (launched: 2022-12-13_15:48:35.338930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:37.205725 run osmo-stp_10.42.42.5(pid=1806): stderr: | [0;m[38;5;43m20221213154835530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154835530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154835530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154835531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154835531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154835531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154835531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:37.363810 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1806): Process ended prematurely: osmo-stp_10.42.42.5(pid=1806) [trial-2391↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1806)] [trial-2391↪sms:oc2g↪mo_mt_sms.py:16] 15:48:37.372911 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 15:48:37.400583 run osmo-hlr_10.42.42.2(pid=1803): ERR: Terminated: ERROR {rc=237} [trial-2391↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1803)] 15:48:37.451876 run osmo-hlr_10.42.42.2(pid=1803): stdout: | (launched: 2022-12-13_15:48:34.299838) 15:48:37.504764 run osmo-hlr_10.42.42.2(pid=1803): stderr: | [0;m[1;31m20221213154834497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154834497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154834497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154834497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154834497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154834497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154834508 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154834517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154834517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154834517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:37.578119 run osmo-msc_10.42.42.6(pid=1809): ERR: Terminated: ERROR {rc=2} [trial-2391↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1809)] 15:48:37.628637 run osmo-msc_10.42.42.6(pid=1809): stdout: | (launched: 2022-12-13_15:48:36.403831) 15:48:37.681842 run osmo-msc_10.42.42.6(pid=1809): stderr: | [0;m[38;5;43m20221213154836726 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154836727 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3dcdf3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154836727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154836727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154836727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154836727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154836729 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154836729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154836729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154836730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:37.734685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1802): Terminating (SIGTERM) 15:48:37.777089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1805): Terminating (SIGTERM) 15:48:37.819795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1808): Terminating (SIGTERM) 15:48:37.862889 --- ParallelTerminationStrategy: PID 1802 died... 15:48:37.883386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1802): Terminated: ok {rc=0} 15:48:37.930739 --- ParallelTerminationStrategy: PID 1805 died... 15:48:37.950857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1805): Terminated: ok {rc=0} 15:48:37.998518 --- ParallelTerminationStrategy: PID 1808 died... 15:48:38.018783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1808): Terminated: ok {rc=0} 15:48:38.108573 bus /sierra_3: Setting Powered False 15:48:39.209047 bus /sierra_3: Setting Powered False 15:48:40.326095 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_ussd:oc2g --------------------------------------------------------------------- 15:48:41.544405 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:41.548533 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 15:48:41.570060 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 15:48:41.577193 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 15:48:41.616435 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 15:48:41.638699 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 15:48:41.645815 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 15:48:42.163772 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2391 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 15:48:42.169105 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 15:48:42.180253 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 15:48:42.216033 tst assert_extension.py: using LAC 34630 15:48:42.339240 tst assert_extension.py: using RAC 205 15:48:42.462552 tst assert_extension.py: using CellId 34630 15:48:42.584807 tst assert_extension.py: using BVCI 34631 15:48:42.695915 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 15:48:42.816427 tst assert_extension.py:10: start nitb and bts... 15:48:43.043036 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:48:43.720860 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1815): Launched 15:48:44.056286 run osmo-nitb_10.42.42.2(pid=1816): Launched 15:48:44.241808 run osmo-nitb_10.42.42.2(pid=1816): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1816)] 15:48:44.390512 run osmo-nitb_10.42.42.2(pid=1816): stdout: | (launched: 2022-12-13_15:48:43.993648) 15:48:44.540866 run osmo-nitb_10.42.42.2(pid=1816): stderr: | (launched: 2022-12-13_15:48:44.043260) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:48:44.691013 run osmo-nitb_10.42.42.2(pid=1816): stdout: | (launched: 2022-12-13_15:48:43.993648) 15:48:44.834999 run osmo-nitb_10.42.42.2(pid=1816): stderr: | (launched: 2022-12-13_15:48:44.043260) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1816) [trial-2391↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1816)] 15:48:45.182896 tst osmo-nitb_10.42.42.2(pid=1816): stdout: | (launched: 2022-12-13_15:48:43.993648) 15:48:45.317534 tst osmo-nitb_10.42.42.2(pid=1816): stderr: | (launched: 2022-12-13_15:48:44.043260) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:48:45.477034 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1816) [trial-2391↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1816)] [trial-2391↪nitb_ussd:oc2g↪assert_extension.py:12] 15:48:45.486193 tst assert_extension.py:12: Test FAILED (3.3 sec) 15:48:45.493431 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1815): Terminating (SIGTERM) 15:48:45.706429 --- ParallelTerminationStrategy: PID 1815 died... 15:48:45.728359 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1815): Terminated: ok {rc=0} 15:48:45.812908 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 ussd:oc2g --------------------------------------------------------------------- 15:48:46.999045 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:47.003654 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 15:48:47.034969 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 15:48:47.070896 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 15:48:47.113179 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 15:48:47.144247 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 15:48:47.184257 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 15:48:47.687868 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2391 ussd:oc2g assert_extension.py ---------------------------------------------- 15:48:47.693196 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:48:47.703886 tst ussd:oc2g: Using 1 x bts (candidates: 1) 15:48:47.737320 tst assert_extension.py: using LAC 34631 15:48:47.856592 tst assert_extension.py: using RAC 206 15:48:47.975796 tst assert_extension.py: using CellId 34631 15:48:48.094603 tst assert_extension.py: using BVCI 34632 15:48:48.206054 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:48:48.216538 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:48:48.227054 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:48:48.237456 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:48:48.247787 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:48:48.258273 tst ussd:oc2g: Using 1 x modem (candidates: 1) 15:48:48.380045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:48.894367 run create_hlr_db(pid=1821): Launched 15:48:49.023600 bus /sierra_2: Setting Powered False 15:48:50.086191 run create_hlr_db(pid=1821): Terminated: ok {rc=0} 15:48:50.531946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1823): Launched 15:48:50.846041 run osmo-hlr_10.42.42.2(pid=1824): Launched 15:48:50.963961 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:51.506156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1826): Launched 15:48:51.820910 run osmo-stp_10.42.42.5(pid=1827): Launched 15:48:51.941288 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:52.501704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1829): Launched 15:48:52.813485 run osmo-msc_10.42.42.6(pid=1830): Launched 15:48:52.987114 run osmo-stp_10.42.42.5(pid=1827): ERR: Terminated: ERROR {rc=1} [trial-2391↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1827)] 15:48:53.117598 run osmo-stp_10.42.42.5(pid=1827): stdout: | (launched: 2022-12-13_15:48:51.761598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:53.248463 run osmo-stp_10.42.42.5(pid=1827): stderr: | [0;m[38;5;43m20221213154851933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154851933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154851934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154851934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154851935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154851935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154851935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:53.377691 run osmo-stp_10.42.42.5(pid=1827): stdout: | (launched: 2022-12-13_15:48:51.761598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:53.500353 run osmo-stp_10.42.42.5(pid=1827): stderr: | [0;m[38;5;43m20221213154851933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154851933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154851934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154851934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154851935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154851935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154851935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:53.648068 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1827): Process ended prematurely: osmo-stp_10.42.42.5(pid=1827) [trial-2391↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1827)] [trial-2391↪ussd:oc2g↪assert_extension.py:17] 15:48:53.656526 tst assert_extension.py:17: Test FAILED (6.0 sec) 15:48:53.682832 run osmo-hlr_10.42.42.2(pid=1824): ERR: Terminated: ERROR {rc=237} [trial-2391↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1824)] 15:48:53.730752 run osmo-hlr_10.42.42.2(pid=1824): stdout: | (launched: 2022-12-13_15:48:50.786838) 15:48:53.780686 run osmo-hlr_10.42.42.2(pid=1824): stderr: | [0;m[1;31m20221213154850964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154850964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154850964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154850964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154850964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154850964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154850976 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154850985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154850985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154850985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:53.850262 run osmo-msc_10.42.42.6(pid=1830): ERR: Terminated: ERROR {rc=2} [trial-2391↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1830)] 15:48:53.898215 run osmo-msc_10.42.42.6(pid=1830): stdout: | (launched: 2022-12-13_15:48:52.754239) 15:48:53.947824 run osmo-msc_10.42.42.6(pid=1830): stderr: | [0;m[38;5;43m20221213154853029 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154853029 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efec8ef9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154853029 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154853029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154853029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154853030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154853031 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154853032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154853032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154853032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:53.997775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1823): Terminating (SIGTERM) 15:48:54.037746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1826): Terminating (SIGTERM) 15:48:54.077421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1829): Terminating (SIGTERM) 15:48:54.117484 --- ParallelTerminationStrategy: PID 1823 died... 15:48:54.136813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1823): Terminated: ok {rc=0} 15:48:54.180925 --- ParallelTerminationStrategy: PID 1826 died... 15:48:54.199824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1826): Terminated: ok {rc=0} 15:48:54.243766 --- ParallelTerminationStrategy: PID 1829 died... 15:48:54.262409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1829): Terminated: ok {rc=0} 15:48:54.348281 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:48:55.547262 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:55.554170 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:48:55.575197 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:48:55.602832 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:48:55.654506 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:48:55.675079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:48:55.702020 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:48:56.252642 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:48:56.304572 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:56.315691 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:48:56.373129 tst mo_mt_call.py: using LAC 34632 15:48:56.498747 tst mo_mt_call.py: using RAC 207 15:48:56.624187 tst mo_mt_call.py: using CellId 34632 15:48:56.749604 tst mo_mt_call.py: using BVCI 34633 15:48:56.875406 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:56.887309 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:56.898902 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:56.910654 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:56.922551 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:56.934545 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:48:57.057083 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:48:57.182237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:57.708581 run create_hlr_db(pid=1835): Launched 15:48:57.839127 bus /sierra_2: Setting Powered False 15:48:58.905194 run create_hlr_db(pid=1835): Terminated: ok {rc=0} 15:48:59.376519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1837): Launched 15:48:59.718353 run osmo-hlr_10.42.42.2(pid=1838): Launched 15:48:59.847921 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:00.435767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1840): Launched 15:49:00.776894 run osmo-stp_10.42.42.5(pid=1841): Launched 15:49:01.020164 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:01.687805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1843): Launched 15:49:02.028245 run osmo-msc_10.42.42.6(pid=1844): Launched 15:49:02.279503 run osmo-stp_10.42.42.5(pid=1841): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1841)] 15:49:02.495700 run osmo-stp_10.42.42.5(pid=1841): stdout: | (launched: 2022-12-13_15:49:00.713733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:02.639103 run osmo-stp_10.42.42.5(pid=1841): stderr: | [0;m[38;5;43m20221213154900949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154900949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154900950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154900950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154900951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154900951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154900951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:02.781666 run osmo-stp_10.42.42.5(pid=1841): stdout: | (launched: 2022-12-13_15:49:00.713733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:02.916147 run osmo-stp_10.42.42.5(pid=1841): stderr: | [0;m[38;5;43m20221213154900949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154900949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154900950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154900950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154900951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154900951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154900951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:03.077723 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1841): Process ended prematurely: osmo-stp_10.42.42.5(pid=1841) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1841)] [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:49:03.087533 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 15:49:03.115777 run osmo-hlr_10.42.42.2(pid=1838): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1838)] 15:49:03.167299 run osmo-hlr_10.42.42.2(pid=1838): stdout: | (launched: 2022-12-13_15:48:59.654993) 15:49:03.220403 run osmo-hlr_10.42.42.2(pid=1838): stderr: | [0;m[1;31m20221213154859852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154859852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154859852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154859853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154859853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154859853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154859866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154859875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154859875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154859875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:03.293490 run osmo-msc_10.42.42.6(pid=1844): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1844)] 15:49:03.344205 run osmo-msc_10.42.42.6(pid=1844): stdout: | (launched: 2022-12-13_15:49:01.967026) 15:49:03.397113 run osmo-msc_10.42.42.6(pid=1844): stderr: | [0;m[38;5;43m20221213154902449 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154902449 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f83fa8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154902449 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154902450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154902450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154902450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154902451 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154902452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154902452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154902452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:03.449994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1837): Terminating (SIGTERM) 15:49:03.492526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1840): Terminating (SIGTERM) 15:49:03.535655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1843): Terminating (SIGTERM) 15:49:03.579043 --- ParallelTerminationStrategy: PID 1837 died... 15:49:03.599152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1837): Terminated: ok {rc=0} 15:49:03.646276 --- ParallelTerminationStrategy: PID 1840 died... 15:49:03.666448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1840): Terminated: ok {rc=0} 15:49:03.713431 --- ParallelTerminationStrategy: PID 1843 died... 15:49:03.733491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1843): Terminated: ok {rc=0} 15:49:03.823235 bus /sierra_3: Setting Powered False 15:49:04.920891 bus /sierra_3: Setting Powered False 15:49:06.037617 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:49:07.189289 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:49:07.201687 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:49:07.265265 tst mo_mt_call_osmux.py: using LAC 34633 15:49:07.397910 tst mo_mt_call_osmux.py: using RAC 208 15:49:07.522656 tst mo_mt_call_osmux.py: using CellId 34633 15:49:07.646264 tst mo_mt_call_osmux.py: using BVCI 34634 15:49:07.772486 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:49:07.784360 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:49:07.795912 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:49:07.807697 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:49:07.819481 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:49:07.831480 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:49:07.952435 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:49:08.075979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:08.601746 run create_hlr_db(pid=1846): Launched 15:49:08.731296 bus /sierra_2: Setting Powered False 15:49:09.797497 run create_hlr_db(pid=1846): Terminated: ok {rc=0} 15:49:10.251058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1848): Launched 15:49:10.571668 run osmo-hlr_10.42.42.2(pid=1849): Launched 15:49:10.692867 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:11.258155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1851): Launched 15:49:11.579259 run osmo-stp_10.42.42.5(pid=1852): Launched 15:49:11.701335 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:12.273339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1854): Launched 15:49:12.615857 run osmo-msc_10.42.42.6(pid=1855): Launched 15:49:12.806787 run osmo-stp_10.42.42.5(pid=1852): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1852)] 15:49:12.952074 run osmo-stp_10.42.42.5(pid=1852): stdout: | (launched: 2022-12-13_15:49:11.518959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:13.095370 run osmo-stp_10.42.42.5(pid=1852): stderr: | [0;m[38;5;43m20221213154911690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154911690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154911690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154911691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154911691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154911691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154911691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:13.236463 run osmo-stp_10.42.42.5(pid=1852): stdout: | (launched: 2022-12-13_15:49:11.518959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:13.371511 run osmo-stp_10.42.42.5(pid=1852): stderr: | [0;m[38;5;43m20221213154911690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154911690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154911690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154911691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154911691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154911691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154911691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:13.533137 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1852): Process ended prematurely: osmo-stp_10.42.42.5(pid=1852) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1852)] [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:49:13.542890 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:49:13.570985 run osmo-hlr_10.42.42.2(pid=1849): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1849)] 15:49:13.622057 run osmo-hlr_10.42.42.2(pid=1849): stdout: | (launched: 2022-12-13_15:49:10.512035) 15:49:13.674524 run osmo-hlr_10.42.42.2(pid=1849): stderr: | [0;m[1;31m20221213154910688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154910688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154910688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154910688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154910688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154910688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154910701 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154910711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154910711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154910711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:13.747683 run osmo-msc_10.42.42.6(pid=1855): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1855)] 15:49:13.797883 run osmo-msc_10.42.42.6(pid=1855): stdout: | (launched: 2022-12-13_15:49:12.552497) 15:49:13.850413 run osmo-msc_10.42.42.6(pid=1855): stderr: | [0;m[38;5;43m20221213154912874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154912874 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3c31604c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154912875 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154912875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154912875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154912875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154912877 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154912878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154912878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154912878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:13.902561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1848): Terminating (SIGTERM) 15:49:13.945009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1851): Terminating (SIGTERM) 15:49:13.987770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1854): Terminating (SIGTERM) 15:49:14.030920 --- ParallelTerminationStrategy: PID 1848 died... 15:49:14.051373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1848): Terminated: ok {rc=0} 15:49:14.098034 --- ParallelTerminationStrategy: PID 1851 died... 15:49:14.118025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1851): Terminated: ok {rc=0} 15:49:14.164458 --- ParallelTerminationStrategy: PID 1854 died... 15:49:14.184481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1854): Terminated: ok {rc=0} 15:49:14.273812 bus /sierra_3: Setting Powered False 15:49:15.371098 bus /sierra_3: Setting Powered False 15:49:16.498925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:49:17.752050 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:49:17.759254 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:49:17.780646 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:49:17.809262 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:49:17.862664 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:49:17.884251 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:49:17.912436 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:49:18.463373 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:49:18.518696 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:18.530511 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:49:18.588407 tst mo_mt_call.py: using LAC 34634 15:49:18.722437 tst mo_mt_call.py: using RAC 209 15:49:18.855844 tst mo_mt_call.py: using CellId 34634 15:49:18.990893 tst mo_mt_call.py: using BVCI 34635 15:49:19.116319 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:19.128197 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:19.140165 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:19.151843 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:19.163868 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:19.175849 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:49:19.295795 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:49:19.418652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:19.947452 run create_hlr_db(pid=1860): Launched 15:49:20.078697 bus /sierra_2: Setting Powered False 15:49:21.145221 run create_hlr_db(pid=1860): Terminated: ok {rc=0} 15:49:21.600459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1862): Launched 15:49:21.922075 run osmo-hlr_10.42.42.2(pid=1863): Launched 15:49:22.043699 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:22.595493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1865): Launched 15:49:22.915197 run osmo-stp_10.42.42.5(pid=1866): Launched 15:49:23.038184 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:23.610195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1868): Launched 15:49:23.930049 run osmo-msc_10.42.42.6(pid=1869): Launched 15:49:24.107865 run osmo-stp_10.42.42.5(pid=1866): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1866)] 15:49:24.240762 run osmo-stp_10.42.42.5(pid=1866): stdout: | (launched: 2022-12-13_15:49:22.855013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:24.373441 run osmo-stp_10.42.42.5(pid=1866): stderr: | [0;m[38;5;43m20221213154923026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154923026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154923026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154923027 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154923027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154923027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154923027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:24.505266 run osmo-stp_10.42.42.5(pid=1866): stdout: | (launched: 2022-12-13_15:49:22.855013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:24.630291 run osmo-stp_10.42.42.5(pid=1866): stderr: | [0;m[38;5;43m20221213154923026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154923026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154923026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154923027 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154923027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154923027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154923027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:24.780272 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1866): Process ended prematurely: osmo-stp_10.42.42.5(pid=1866) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1866)] [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:49:24.789290 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:49:24.816074 run osmo-hlr_10.42.42.2(pid=1863): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1863)] 15:49:24.864594 run osmo-hlr_10.42.42.2(pid=1863): stdout: | (launched: 2022-12-13_15:49:21.861795) 15:49:24.914487 run osmo-hlr_10.42.42.2(pid=1863): stderr: | [0;m[1;31m20221213154922039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154922039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154922039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154922039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154922040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154922040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154922052 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154922062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154922062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154922063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:24.984407 run osmo-msc_10.42.42.6(pid=1869): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1869)] 15:49:25.032655 run osmo-msc_10.42.42.6(pid=1869): stdout: | (launched: 2022-12-13_15:49:23.870121) 15:49:25.082543 run osmo-msc_10.42.42.6(pid=1869): stderr: | [0;m[38;5;43m20221213154924147 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154924147 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f163869cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154924147 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154924147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154924147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154924147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154924149 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154924150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154924150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154924150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:25.132850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1862): Terminating (SIGTERM) 15:49:25.173003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1865): Terminating (SIGTERM) 15:49:25.212924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1868): Terminating (SIGTERM) 15:49:25.253375 --- ParallelTerminationStrategy: PID 1862 died... 15:49:25.272323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1862): Terminated: ok {rc=0} 15:49:25.316780 --- ParallelTerminationStrategy: PID 1865 died... 15:49:25.335633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1865): Terminated: ok {rc=0} 15:49:25.379610 --- ParallelTerminationStrategy: PID 1868 died... 15:49:25.398379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1868): Terminated: ok {rc=0} 15:49:25.493254 bus /sierra_3: Setting Powered False 15:49:26.591261 bus /sierra_3: Setting Powered False 15:49:27.706955 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:49:28.856918 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:28.869194 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:49:28.930078 tst mo_mt_call_osmux.py: using LAC 34635 15:49:29.060694 tst mo_mt_call_osmux.py: using RAC 210 15:49:29.192273 tst mo_mt_call_osmux.py: using CellId 34635 15:49:29.320487 tst mo_mt_call_osmux.py: using BVCI 34636 15:49:29.439592 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:29.451095 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:29.462446 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:29.473824 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:29.485487 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:29.497155 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:49:29.618141 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:49:29.739286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:30.214623 run create_hlr_db(pid=1871): Launched 15:49:30.342565 bus /sierra_2: Setting Powered False 15:49:31.403231 run create_hlr_db(pid=1871): Terminated: ok {rc=0} 15:49:31.847272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1873): Launched 15:49:32.180375 run osmo-hlr_10.42.42.2(pid=1874): Launched 15:49:32.298302 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:32.847459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1876): Launched 15:49:33.160495 run osmo-stp_10.42.42.5(pid=1877): Launched 15:49:33.279034 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:33.841580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1879): Launched 15:49:34.154489 run osmo-msc_10.42.42.6(pid=1881): Launched 15:49:34.329471 run osmo-stp_10.42.42.5(pid=1877): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1877)] 15:49:34.461735 run osmo-stp_10.42.42.5(pid=1877): stdout: | (launched: 2022-12-13_15:49:33.101454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:34.592796 run osmo-stp_10.42.42.5(pid=1877): stderr: | [0;m[38;5;43m20221213154933271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154933272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154933272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154933273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154933274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154933274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154933274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:34.722697 run osmo-stp_10.42.42.5(pid=1877): stdout: | (launched: 2022-12-13_15:49:33.101454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:34.846942 run osmo-stp_10.42.42.5(pid=1877): stderr: | [0;m[38;5;43m20221213154933271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154933272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154933272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154933273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154933274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154933274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154933274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:34.995430 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1877): Process ended prematurely: osmo-stp_10.42.42.5(pid=1877) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1877)] [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:49:35.004460 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:49:35.031124 run osmo-hlr_10.42.42.2(pid=1874): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1874)] 15:49:35.078885 run osmo-hlr_10.42.42.2(pid=1874): stdout: | (launched: 2022-12-13_15:49:32.118115) 15:49:35.128374 run osmo-hlr_10.42.42.2(pid=1874): stderr: | [0;m[1;31m20221213154932308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154932308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154932308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154932308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154932308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154932308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154932320 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154932329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154932329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154932329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:35.197586 run osmo-msc_10.42.42.6(pid=1881): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1881)] 15:49:35.245333 run osmo-msc_10.42.42.6(pid=1881): stdout: | (launched: 2022-12-13_15:49:34.095420) 15:49:35.294728 run osmo-msc_10.42.42.6(pid=1881): stderr: | [0;m[38;5;43m20221213154934369 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154934370 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe6bc261c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154934370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154934370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154934370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154934370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154934372 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154934372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154934372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154934373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:35.344741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1873): Terminating (SIGTERM) 15:49:35.384480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1876): Terminating (SIGTERM) 15:49:35.424298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1879): Terminating (SIGTERM) 15:49:35.464347 --- ParallelTerminationStrategy: PID 1873 died... 15:49:35.483489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1873): Terminated: ok {rc=0} 15:49:35.527423 --- ParallelTerminationStrategy: PID 1876 died... 15:49:35.545988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1876): Terminated: ok {rc=0} 15:49:35.590045 --- ParallelTerminationStrategy: PID 1879 died... 15:49:35.608677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1879): Terminated: ok {rc=0} 15:49:35.692864 bus /sierra_3: Setting Powered False 15:49:36.790553 bus /sierra_3: Setting Powered False 15:49:37.910209 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:49:39.145876 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:49:39.152097 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:49:39.172908 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:49:39.199921 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:49:39.251998 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:49:39.272517 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:49:39.299641 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:49:39.852909 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:49:39.908067 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:39.919739 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:49:39.978489 tst mo_mt_call.py: using LAC 34636 15:49:40.112291 tst mo_mt_call.py: using RAC 211 15:49:40.245218 tst mo_mt_call.py: using CellId 34636 15:49:40.379332 tst mo_mt_call.py: using BVCI 34637 15:49:40.502158 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:40.514028 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:40.525640 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:40.537177 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:40.548936 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:40.561261 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:49:40.680180 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:49:40.802639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:41.327514 run create_hlr_db(pid=1886): Launched 15:49:41.455658 bus /sierra_2: Setting Powered False 15:49:42.518105 run create_hlr_db(pid=1886): Terminated: ok {rc=0} 15:49:42.987571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1888): Launched 15:49:43.325782 run osmo-hlr_10.42.42.2(pid=1889): Launched 15:49:43.456276 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:44.039309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1891): Launched 15:49:44.379250 run osmo-stp_10.42.42.5(pid=1892): Launched 15:49:44.508938 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:45.117330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1894): Launched 15:49:45.456795 run osmo-msc_10.42.42.6(pid=1895): Launched 15:49:45.645888 run osmo-stp_10.42.42.5(pid=1892): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1892)] 15:49:45.787662 run osmo-stp_10.42.42.5(pid=1892): stdout: | (launched: 2022-12-13_15:49:44.316237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:46.020670 run osmo-stp_10.42.42.5(pid=1892): stderr: | [0;m[38;5;43m20221213154944509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154944509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154944510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154944510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154944511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154944511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154944511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:46.171521 run osmo-stp_10.42.42.5(pid=1892): stdout: | (launched: 2022-12-13_15:49:44.316237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:46.308127 run osmo-stp_10.42.42.5(pid=1892): stderr: | [0;m[38;5;43m20221213154944509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154944509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154944510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154944510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154944511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154944511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154944511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:46.471846 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1892): Process ended prematurely: osmo-stp_10.42.42.5(pid=1892) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1892)] [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:49:46.483049 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 15:49:46.510496 run osmo-hlr_10.42.42.2(pid=1889): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1889)] 15:49:46.559727 run osmo-hlr_10.42.42.2(pid=1889): stdout: | (launched: 2022-12-13_15:49:43.263201) 15:49:46.611266 run osmo-hlr_10.42.42.2(pid=1889): stderr: | [0;m[1;31m20221213154943461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154943461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154943461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154943461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154943461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154943461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154943475 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154943483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154943483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154943483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:46.684149 run osmo-msc_10.42.42.6(pid=1895): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1895)] 15:49:46.733644 run osmo-msc_10.42.42.6(pid=1895): stdout: | (launched: 2022-12-13_15:49:45.394098) 15:49:46.785271 run osmo-msc_10.42.42.6(pid=1895): stderr: | [0;m[38;5;43m20221213154945717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154945717 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe3c6c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154945718 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154945718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154945718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154945718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154945720 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154945720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154945720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154945720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:46.836936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1888): Terminating (SIGTERM) 15:49:46.880540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1891): Terminating (SIGTERM) 15:49:46.924183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1894): Terminating (SIGTERM) 15:49:46.968726 --- ParallelTerminationStrategy: PID 1888 died... 15:49:46.989439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1888): Terminated: ok {rc=0} 15:49:47.036600 --- ParallelTerminationStrategy: PID 1891 died... 15:49:47.057701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1891): Terminated: ok {rc=0} 15:49:47.106185 --- ParallelTerminationStrategy: PID 1894 died... 15:49:47.128011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1894): Terminated: ok {rc=0} 15:49:47.215937 bus /sierra_3: Setting Powered False 15:49:48.316442 bus /sierra_3: Setting Powered False 15:49:49.433667 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:49:50.585880 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:50.598243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:49:50.656742 tst mo_mt_call_osmux.py: using LAC 34637 15:49:50.789159 tst mo_mt_call_osmux.py: using RAC 212 15:49:50.912940 tst mo_mt_call_osmux.py: using CellId 34637 15:49:51.036832 tst mo_mt_call_osmux.py: using BVCI 34638 15:49:51.152436 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:51.163806 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:51.175030 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:51.186070 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:51.196901 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:51.207881 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:49:51.331774 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:49:51.453046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:51.940628 run create_hlr_db(pid=1897): Launched 15:49:52.070637 bus /sierra_2: Setting Powered False 15:49:53.132892 run create_hlr_db(pid=1897): Terminated: ok {rc=0} 15:49:53.591644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1899): Launched 15:49:53.930069 run osmo-hlr_10.42.42.2(pid=1900): Launched 15:49:54.058418 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:54.642302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1902): Launched 15:49:54.981281 run osmo-stp_10.42.42.5(pid=1903): Launched 15:49:55.110772 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:55.718801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1905): Launched 15:49:56.058845 run osmo-msc_10.42.42.6(pid=1906): Launched 15:49:56.248022 run osmo-stp_10.42.42.5(pid=1903): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1903)] 15:49:56.391961 run osmo-stp_10.42.42.5(pid=1903): stdout: | (launched: 2022-12-13_15:49:54.918493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:56.538411 run osmo-stp_10.42.42.5(pid=1903): stderr: | [0;m[38;5;43m20221213154955111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154955111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154955111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154955112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154955112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154955112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154955112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:56.699985 run osmo-stp_10.42.42.5(pid=1903): stdout: | (launched: 2022-12-13_15:49:54.918493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:56.830689 run osmo-stp_10.42.42.5(pid=1903): stderr: | [0;m[38;5;43m20221213154955111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213154955111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213154955111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213154955112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213154955112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213154955112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213154955112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:56.987196 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1903): Process ended prematurely: osmo-stp_10.42.42.5(pid=1903) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1903)] [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:49:56.996638 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:49:57.024610 run osmo-hlr_10.42.42.2(pid=1900): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1900)] 15:49:57.075063 run osmo-hlr_10.42.42.2(pid=1900): stdout: | (launched: 2022-12-13_15:49:53.867202) 15:49:57.126809 run osmo-hlr_10.42.42.2(pid=1900): stderr: | [0;m[1;31m20221213154954064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213154954064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213154954064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213154954065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213154954065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213154954065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213154954078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213154954086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213154954086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213154954086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:57.199448 run osmo-msc_10.42.42.6(pid=1906): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1906)] 15:49:57.249122 run osmo-msc_10.42.42.6(pid=1906): stdout: | (launched: 2022-12-13_15:49:55.995326) 15:49:57.300599 run osmo-msc_10.42.42.6(pid=1906): stderr: | [0;m[38;5;43m20221213154956321 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213154956321 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe9e0e8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213154956321 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213154956321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213154956321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213154956321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213154956324 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213154956324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213154956324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213154956324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:57.352744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1899): Terminating (SIGTERM) 15:49:57.394642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1902): Terminating (SIGTERM) 15:49:57.436536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1905): Terminating (SIGTERM) 15:49:57.479129 --- ParallelTerminationStrategy: PID 1899 died... 15:49:57.499378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1899): Terminated: ok {rc=0} 15:49:57.545556 --- ParallelTerminationStrategy: PID 1902 died... 15:49:57.565328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1902): Terminated: ok {rc=0} 15:49:57.611368 --- ParallelTerminationStrategy: PID 1905 died... 15:49:57.631033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1905): Terminated: ok {rc=0} 15:49:57.718802 bus /sierra_3: Setting Powered False 15:49:58.816258 bus /sierra_3: Setting Powered False 15:49:59.928102 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:50:01.180634 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:50:01.187181 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:50:01.208321 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:50:01.237218 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:50:01.290012 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:50:01.313801 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:50:01.341953 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:50:01.892009 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:50:01.964361 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:01.977653 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:50:02.049954 tst mo_mt_call.py: using LAC 34638 15:50:02.186215 tst mo_mt_call.py: using RAC 213 15:50:02.318117 tst mo_mt_call.py: using CellId 34638 15:50:02.448836 tst mo_mt_call.py: using BVCI 34639 15:50:02.571849 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:02.583535 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:02.595107 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:02.606744 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:02.618727 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:02.630751 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:50:02.749720 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:50:02.874319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:03.391754 run create_hlr_db(pid=1914): Launched 15:50:03.519425 bus /sierra_2: Setting Powered False 15:50:04.585062 run create_hlr_db(pid=1914): Terminated: ok {rc=0} 15:50:05.028884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1916): Launched 15:50:05.341197 run osmo-hlr_10.42.42.2(pid=1917): Launched 15:50:05.461095 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:06.007974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1919): Launched 15:50:06.318618 run osmo-stp_10.42.42.5(pid=1920): Launched 15:50:06.440347 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:07.001474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1922): Launched 15:50:07.311691 run osmo-msc_10.42.42.6(pid=1923): Launched 15:50:07.487793 run osmo-stp_10.42.42.5(pid=1920): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1920)] 15:50:07.618306 run osmo-stp_10.42.42.5(pid=1920): stdout: | (launched: 2022-12-13_15:50:06.261619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:07.748576 run osmo-stp_10.42.42.5(pid=1920): stderr: | [0;m[38;5;43m20221213155006429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155006429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155006430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155006430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155006431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155006431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155006431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:07.877727 run osmo-stp_10.42.42.5(pid=1920): stdout: | (launched: 2022-12-13_15:50:06.261619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:08.000581 run osmo-stp_10.42.42.5(pid=1920): stderr: | [0;m[38;5;43m20221213155006429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155006429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155006430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155006430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155006431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155006431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155006431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:08.148357 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1920): Process ended prematurely: osmo-stp_10.42.42.5(pid=1920) [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1920)] [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:50:08.157415 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:50:08.184183 run osmo-hlr_10.42.42.2(pid=1917): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1917)] 15:50:08.232261 run osmo-hlr_10.42.42.2(pid=1917): stdout: | (launched: 2022-12-13_15:50:05.284071) 15:50:08.282104 run osmo-hlr_10.42.42.2(pid=1917): stderr: | [0;m[1;31m20221213155005457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155005457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155005457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155005457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155005457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155005457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155005469 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155005480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155005480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155005480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:08.351864 run osmo-msc_10.42.42.6(pid=1923): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1923)] 15:50:08.401054 run osmo-msc_10.42.42.6(pid=1923): stdout: | (launched: 2022-12-13_15:50:07.254508) 15:50:08.451268 run osmo-msc_10.42.42.6(pid=1923): stderr: | [0;m[38;5;43m20221213155007526 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155007526 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f58abb04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155007526 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155007526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155007526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155007527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155007528 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155007529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155007529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155007529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:08.501451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1916): Terminating (SIGTERM) 15:50:08.541288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1919): Terminating (SIGTERM) 15:50:08.581142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1922): Terminating (SIGTERM) 15:50:08.621216 --- ParallelTerminationStrategy: PID 1916 died... 15:50:08.640468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1916): Terminated: ok {rc=0} 15:50:08.684661 --- ParallelTerminationStrategy: PID 1919 died... 15:50:08.703223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1919): Terminated: ok {rc=0} 15:50:08.747386 --- ParallelTerminationStrategy: PID 1922 died... 15:50:08.766140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1922): Terminated: ok {rc=0} 15:50:08.852368 bus /sierra_3: Setting Powered False 15:50:09.951223 bus /sierra_3: Setting Powered False 15:50:11.067235 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:50:12.219090 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:12.231281 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:50:12.290355 tst mo_mt_call_osmux.py: using LAC 34639 15:50:12.422451 tst mo_mt_call_osmux.py: using RAC 214 15:50:12.554619 tst mo_mt_call_osmux.py: using CellId 34639 15:50:12.690411 tst mo_mt_call_osmux.py: using BVCI 34640 15:50:12.813504 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:12.825078 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:12.836417 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:12.847849 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:12.859558 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:12.871328 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:50:12.990285 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:50:13.113672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:13.633940 run create_hlr_db(pid=1925): Launched 15:50:13.763287 bus /sierra_2: Setting Powered False 15:50:14.829850 run create_hlr_db(pid=1925): Terminated: ok {rc=0} 15:50:15.276496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1927): Launched 15:50:15.589196 run osmo-hlr_10.42.42.2(pid=1928): Launched 15:50:15.708371 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:16.269597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1932): Launched 15:50:16.640857 run osmo-stp_10.42.42.5(pid=1933): Launched 15:50:16.912366 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:17.562382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1935): Launched 15:50:17.898112 run osmo-msc_10.42.42.6(pid=1936): Launched 15:50:18.086604 run osmo-stp_10.42.42.5(pid=1933): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1933)] 15:50:18.226902 run osmo-stp_10.42.42.5(pid=1933): stdout: | (launched: 2022-12-13_15:50:16.580639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:18.368150 run osmo-stp_10.42.42.5(pid=1933): stderr: | [0;m[38;5;43m20221213155016853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155016853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155016853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155016854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155016854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155016854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155016854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:18.507638 run osmo-stp_10.42.42.5(pid=1933): stdout: | (launched: 2022-12-13_15:50:16.580639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:18.640781 run osmo-stp_10.42.42.5(pid=1933): stderr: | [0;m[38;5;43m20221213155016853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155016853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155016853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155016854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155016854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155016854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155016854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:18.800010 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1933): Process ended prematurely: osmo-stp_10.42.42.5(pid=1933) [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1933)] [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:50:18.809781 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 15:50:18.837893 run osmo-hlr_10.42.42.2(pid=1928): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1928)] 15:50:18.888485 run osmo-hlr_10.42.42.2(pid=1928): stdout: | (launched: 2022-12-13_15:50:15.531562) 15:50:18.940542 run osmo-hlr_10.42.42.2(pid=1928): stderr: | [0;m[1;31m20221213155015707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155015707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155015707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155015707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155015707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155015707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155015719 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155015727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155015727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155015727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:19.013621 run osmo-msc_10.42.42.6(pid=1936): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1936)] 15:50:19.063721 run osmo-msc_10.42.42.6(pid=1936): stdout: | (launched: 2022-12-13_15:50:17.837063) 15:50:19.115635 run osmo-msc_10.42.42.6(pid=1936): stderr: | [0;m[38;5;43m20221213155018158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155018158 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f77673c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155018158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155018158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155018159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155018159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155018160 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155018161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155018161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155018161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:19.168037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1927): Terminating (SIGTERM) 15:50:19.210283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1932): Terminating (SIGTERM) 15:50:19.253106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1935): Terminating (SIGTERM) 15:50:19.295661 --- ParallelTerminationStrategy: PID 1927 died... 15:50:19.316180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1927): Terminated: ok {rc=0} 15:50:19.362888 --- ParallelTerminationStrategy: PID 1932 died... 15:50:19.382771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1932): Terminated: ok {rc=0} 15:50:19.429390 --- ParallelTerminationStrategy: PID 1935 died... 15:50:19.449178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1935): Terminated: ok {rc=0} 15:50:19.537354 bus /sierra_3: Setting Powered False 15:50:20.635116 bus /sierra_3: Setting Powered False 15:50:21.751256 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:50:22.990553 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:50:22.997519 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:50:23.019151 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:50:23.047625 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:50:23.100779 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:50:23.122505 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:50:23.150554 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:50:23.702199 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:50:23.756640 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:23.768389 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:50:23.826635 tst mo_mt_call.py: using LAC 34640 15:50:23.959093 tst mo_mt_call.py: using RAC 215 15:50:24.092091 tst mo_mt_call.py: using CellId 34640 15:50:24.227728 tst mo_mt_call.py: using BVCI 34641 15:50:24.350582 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:24.362317 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:24.373729 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:24.385064 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:24.396703 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:24.408572 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:50:24.526969 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:50:24.649624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:25.132547 run create_hlr_db(pid=1941): Launched 15:50:25.261881 bus /sierra_2: Setting Powered False 15:50:26.323992 run create_hlr_db(pid=1941): Terminated: ok {rc=0} 15:50:26.758300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1943): Launched 15:50:27.070955 run osmo-hlr_10.42.42.2(pid=1944): Launched 15:50:27.189810 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:27.737720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1946): Launched 15:50:28.050556 run osmo-stp_10.42.42.5(pid=1947): Launched 15:50:28.169685 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:28.735754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1949): Launched 15:50:29.050017 run osmo-msc_10.42.42.6(pid=1950): Launched 15:50:29.226069 run osmo-stp_10.42.42.5(pid=1947): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1947)] 15:50:29.357960 run osmo-stp_10.42.42.5(pid=1947): stdout: | (launched: 2022-12-13_15:50:27.992876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:29.489123 run osmo-stp_10.42.42.5(pid=1947): stderr: | [0;m[38;5;43m20221213155028163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155028163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155028163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155028164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155028164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155028164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155028164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:29.618602 run osmo-stp_10.42.42.5(pid=1947): stdout: | (launched: 2022-12-13_15:50:27.992876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:29.742135 run osmo-stp_10.42.42.5(pid=1947): stderr: | [0;m[38;5;43m20221213155028163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155028163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155028163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155028164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155028164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155028164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155028164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:29.890728 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1947): Process ended prematurely: osmo-stp_10.42.42.5(pid=1947) [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1947)] [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:50:29.899596 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:50:29.926479 run osmo-hlr_10.42.42.2(pid=1944): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1944)] 15:50:29.975125 run osmo-hlr_10.42.42.2(pid=1944): stdout: | (launched: 2022-12-13_15:50:27.013488) 15:50:30.025107 run osmo-hlr_10.42.42.2(pid=1944): stderr: | [0;m[1;31m20221213155027191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155027191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155027191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155027191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155027191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155027191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155027204 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155027214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155027215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155027215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:30.094863 run osmo-msc_10.42.42.6(pid=1950): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1950)] 15:50:30.142888 run osmo-msc_10.42.42.6(pid=1950): stdout: | (launched: 2022-12-13_15:50:28.991662) 15:50:30.192688 run osmo-msc_10.42.42.6(pid=1950): stderr: | [0;m[38;5;43m20221213155029263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155029263 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc24edc9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155029263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155029263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155029263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155029263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155029265 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155029265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155029266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155029266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:30.242960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1943): Terminating (SIGTERM) 15:50:30.283021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1946): Terminating (SIGTERM) 15:50:30.322989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1949): Terminating (SIGTERM) 15:50:30.363445 --- ParallelTerminationStrategy: PID 1943 died... 15:50:30.382907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1943): Terminated: ok {rc=0} 15:50:30.427364 --- ParallelTerminationStrategy: PID 1946 died... 15:50:30.446323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1946): Terminated: ok {rc=0} 15:50:30.490635 --- ParallelTerminationStrategy: PID 1949 died... 15:50:30.509551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1949): Terminated: ok {rc=0} 15:50:30.596796 bus /sierra_3: Setting Powered False 15:50:31.701174 bus /sierra_3: Setting Powered False 15:50:32.821866 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:50:33.971441 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:33.983246 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:50:34.044337 tst mo_mt_call_osmux.py: using LAC 34641 15:50:34.174994 tst mo_mt_call_osmux.py: using RAC 216 15:50:34.303881 tst mo_mt_call_osmux.py: using CellId 34641 15:50:34.434556 tst mo_mt_call_osmux.py: using BVCI 34642 15:50:34.556431 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:34.568267 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:34.580014 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:34.591507 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:34.603373 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:34.615282 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:50:34.735408 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:50:34.856283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:35.340909 run create_hlr_db(pid=1952): Launched 15:50:35.469792 bus /sierra_2: Setting Powered False 15:50:36.531981 run create_hlr_db(pid=1952): Terminated: ok {rc=0} 15:50:36.986956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1954): Launched 15:50:37.323609 run osmo-hlr_10.42.42.2(pid=1955): Launched 15:50:37.454230 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:38.030687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1957): Launched 15:50:38.367406 run osmo-stp_10.42.42.5(pid=1958): Launched 15:50:38.495296 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:39.100491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1960): Launched 15:50:39.436190 run osmo-msc_10.42.42.6(pid=1961): Launched 15:50:39.623245 run osmo-stp_10.42.42.5(pid=1958): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1958)] 15:50:39.763984 run osmo-stp_10.42.42.5(pid=1958): stdout: | (launched: 2022-12-13_15:50:38.305738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:39.905626 run osmo-stp_10.42.42.5(pid=1958): stderr: | [0;m[38;5;43m20221213155038496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155038496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155038497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155038497 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155038498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155038498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155038498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:40.045631 run osmo-stp_10.42.42.5(pid=1958): stdout: | (launched: 2022-12-13_15:50:38.305738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:40.178649 run osmo-stp_10.42.42.5(pid=1958): stderr: | [0;m[38;5;43m20221213155038496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155038496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155038497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155038497 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155038498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155038498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155038498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:40.338430 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1958): Process ended prematurely: osmo-stp_10.42.42.5(pid=1958) [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1958)] [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:50:40.348070 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:50:40.376511 run osmo-hlr_10.42.42.2(pid=1955): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1955)] 15:50:40.427749 run osmo-hlr_10.42.42.2(pid=1955): stdout: | (launched: 2022-12-13_15:50:37.262257) 15:50:40.480507 run osmo-hlr_10.42.42.2(pid=1955): stderr: | [0;m[1;31m20221213155037457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155037457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155037457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155037457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155037457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155037457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155037470 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155037479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155037480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155037480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:40.553949 run osmo-msc_10.42.42.6(pid=1961): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1961)] 15:50:40.604469 run osmo-msc_10.42.42.6(pid=1961): stdout: | (launched: 2022-12-13_15:50:39.374522) 15:50:40.657636 run osmo-msc_10.42.42.6(pid=1961): stderr: | [0;m[38;5;43m20221213155039696 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155039696 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f063ccb5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155039696 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155039696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155039696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155039696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155039698 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155039699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155039699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155039699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:40.710437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1954): Terminating (SIGTERM) 15:50:40.753055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1957): Terminating (SIGTERM) 15:50:40.796430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1960): Terminating (SIGTERM) 15:50:40.839549 --- ParallelTerminationStrategy: PID 1954 died... 15:50:40.860345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1954): Terminated: ok {rc=0} 15:50:40.907278 --- ParallelTerminationStrategy: PID 1957 died... 15:50:40.927468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1957): Terminated: ok {rc=0} 15:50:40.974105 --- ParallelTerminationStrategy: PID 1960 died... 15:50:40.994197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1960): Terminated: ok {rc=0} 15:50:41.083591 bus /sierra_3: Setting Powered False 15:50:42.183550 bus /sierra_3: Setting Powered False 15:50:43.302871 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:50:44.542681 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:50:44.549513 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:50:44.570384 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:50:44.597662 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:50:44.648698 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:50:44.669806 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:50:44.696503 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:50:45.248198 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:50:45.298450 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:45.309776 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:50:45.370159 tst mo_mt_call.py: using LAC 34642 15:50:45.497301 tst mo_mt_call.py: using RAC 217 15:50:45.619234 tst mo_mt_call.py: using CellId 34642 15:50:45.741166 tst mo_mt_call.py: using BVCI 34643 15:50:45.858371 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:45.870526 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:45.882343 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:45.902626 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:45.914619 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:45.927072 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:50:46.068309 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:50:46.187893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:46.685424 run create_hlr_db(pid=1969): Launched 15:50:46.848468 bus /sierra_2: Setting Powered False 15:50:47.909399 run create_hlr_db(pid=1969): Terminated: ok {rc=0} 15:50:48.343039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1971): Launched 15:50:48.657244 run osmo-hlr_10.42.42.2(pid=1972): Launched 15:50:48.776534 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:49.312589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1974): Launched 15:50:49.626344 run osmo-stp_10.42.42.5(pid=1975): Launched 15:50:49.745518 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:50.308807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1977): Launched 15:50:50.621500 run osmo-msc_10.42.42.6(pid=1978): Launched 15:50:50.795511 run osmo-stp_10.42.42.5(pid=1975): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1975)] 15:50:50.926180 run osmo-stp_10.42.42.5(pid=1975): stdout: | (launched: 2022-12-13_15:50:49.568290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:51.057387 run osmo-stp_10.42.42.5(pid=1975): stderr: | [0;m[38;5;43m20221213155049738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155049738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155049739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155049739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155049739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155049739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155049740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:51.187013 run osmo-stp_10.42.42.5(pid=1975): stdout: | (launched: 2022-12-13_15:50:49.568290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:51.309877 run osmo-stp_10.42.42.5(pid=1975): stderr: | [0;m[38;5;43m20221213155049738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155049738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155049739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155049739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155049739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155049739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155049740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:51.457870 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1975): Process ended prematurely: osmo-stp_10.42.42.5(pid=1975) [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1975)] [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:50:51.466790 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:50:51.493538 run osmo-hlr_10.42.42.2(pid=1972): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1972)] 15:50:51.540890 run osmo-hlr_10.42.42.2(pid=1972): stdout: | (launched: 2022-12-13_15:50:48.598780) 15:50:51.590092 run osmo-hlr_10.42.42.2(pid=1972): stderr: | [0;m[1;31m20221213155048775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155048775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155048775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155048775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155048775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155048775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155048787 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155048797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155048798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155048798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:51.659129 run osmo-msc_10.42.42.6(pid=1978): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1978)] 15:50:51.706592 run osmo-msc_10.42.42.6(pid=1978): stdout: | (launched: 2022-12-13_15:50:50.563443) 15:50:51.755589 run osmo-msc_10.42.42.6(pid=1978): stderr: | [0;m[38;5;43m20221213155050835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155050835 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3e7ca7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155050835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155050835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155050835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155050835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155050837 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155050838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155050838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155050838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:51.805224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1971): Terminating (SIGTERM) 15:50:51.844612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1974): Terminating (SIGTERM) 15:50:51.887178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1977): Terminating (SIGTERM) 15:50:51.926896 --- ParallelTerminationStrategy: PID 1971 died... 15:50:51.946008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1971): Terminated: ok {rc=0} 15:50:51.989848 --- ParallelTerminationStrategy: PID 1974 died... 15:50:52.008482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1974): Terminated: ok {rc=0} 15:50:52.052491 --- ParallelTerminationStrategy: PID 1977 died... 15:50:52.071274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1977): Terminated: ok {rc=0} 15:50:52.155367 bus /sierra_3: Setting Powered False 15:50:53.254855 bus /sierra_3: Setting Powered False 15:50:54.371985 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:50:55.523864 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:55.536203 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:50:55.596169 tst mo_mt_call_osmux.py: using LAC 34643 15:50:55.729241 tst mo_mt_call_osmux.py: using RAC 218 15:50:55.860073 tst mo_mt_call_osmux.py: using CellId 34643 15:50:55.994484 tst mo_mt_call_osmux.py: using BVCI 34644 15:50:56.118651 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:56.130505 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:56.142033 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:56.153641 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:56.165606 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:56.177574 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:50:56.297151 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:50:56.421089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:56.941637 run create_hlr_db(pid=1982): Launched 15:50:57.070014 bus /sierra_2: Setting Powered False 15:50:58.136061 run create_hlr_db(pid=1982): Terminated: ok {rc=0} 15:50:58.601629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1984): Launched 15:50:58.939159 run osmo-hlr_10.42.42.2(pid=1985): Launched 15:50:59.068161 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:59.650616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1987): Launched 15:50:59.987928 run osmo-stp_10.42.42.5(pid=1988): Launched 15:51:00.117516 run osmo-msc_10.42.42.6: Starting osmo-msc 15:51:00.724795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1990): Launched 15:51:01.067049 run osmo-msc_10.42.42.6(pid=1991): Launched 15:51:01.298460 run osmo-stp_10.42.42.5(pid=1988): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1988)] 15:51:01.608788 run osmo-stp_10.42.42.5(pid=1988): stdout: | (launched: 2022-12-13_15:50:59.926318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:01.876314 run osmo-stp_10.42.42.5(pid=1988): stderr: | [0;m[38;5;43m20221213155100117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155100117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155100117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155100118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155100118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155100118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155100118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:02.011127 run osmo-stp_10.42.42.5(pid=1988): stdout: | (launched: 2022-12-13_15:50:59.926318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:02.139937 run osmo-stp_10.42.42.5(pid=1988): stderr: | [0;m[38;5;43m20221213155100117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155100117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155100117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155100118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155100118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155100118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155100118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:02.295946 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1988): Process ended prematurely: osmo-stp_10.42.42.5(pid=1988) [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1988)] [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:51:02.305825 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 15:51:02.334387 run osmo-hlr_10.42.42.2(pid=1985): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1985)] 15:51:02.384224 run osmo-hlr_10.42.42.2(pid=1985): stdout: | (launched: 2022-12-13_15:50:58.877560) 15:51:02.434163 run osmo-hlr_10.42.42.2(pid=1985): stderr: | [0;m[1;31m20221213155059074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155059074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155059075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155059075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155059075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155059075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155059088 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155059098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155059098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155059099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:02.504293 run osmo-msc_10.42.42.6(pid=1991): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1991)] 15:51:02.552393 run osmo-msc_10.42.42.6(pid=1991): stdout: | (launched: 2022-12-13_15:51:01.003627) 15:51:02.602405 run osmo-msc_10.42.42.6(pid=1991): stderr: | [0;m[38;5;43m20221213155101515 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155101515 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e79fc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155101515 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155101515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155101515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155101515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155101517 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155101518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155101518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155101518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:51:02.652550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1984): Terminating (SIGTERM) 15:51:02.693068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1987): Terminating (SIGTERM) 15:51:02.733363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1990): Terminating (SIGTERM) 15:51:02.773870 --- ParallelTerminationStrategy: PID 1984 died... 15:51:02.792878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1984): Terminated: ok {rc=0} 15:51:02.837915 --- ParallelTerminationStrategy: PID 1987 died... 15:51:02.856980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1987): Terminated: ok {rc=0} 15:51:02.900936 --- ParallelTerminationStrategy: PID 1990 died... 15:51:02.919808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1990): Terminated: ok {rc=0} 15:51:03.004985 bus /sierra_3: Setting Powered False 15:51:04.103322 bus /sierra_3: Setting Powered False 15:51:05.220526 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:51:06.459435 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:51:06.465833 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:51:06.487163 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:51:06.515743 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:51:06.569661 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:51:06.591474 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:51:06.619353 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:51:07.170495 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:51:07.224665 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:07.236065 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:51:07.295631 tst mo_mt_call.py: using LAC 34644 15:51:07.427943 tst mo_mt_call.py: using RAC 219 15:51:07.558707 tst mo_mt_call.py: using CellId 34644 15:51:07.691875 tst mo_mt_call.py: using BVCI 34645 15:51:07.815132 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:07.826610 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:07.837884 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:07.849087 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:07.860834 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:07.872401 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:51:07.992539 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:51:08.115198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:08.635039 run create_hlr_db(pid=1996): Launched 15:51:08.763780 bus /sierra_2: Setting Powered False 15:51:09.830324 run create_hlr_db(pid=1996): Terminated: ok {rc=0} 15:51:10.277589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1998): Launched 15:51:10.591818 run osmo-hlr_10.42.42.2(pid=1999): Launched 15:51:10.711899 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:11.250973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2001): Launched 15:51:11.566146 run osmo-stp_10.42.42.5(pid=2002): Launched 15:51:11.686181 run osmo-msc_10.42.42.6: Starting osmo-msc 15:51:12.250588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2004): Launched 15:51:12.564043 run osmo-msc_10.42.42.6(pid=2005): Launched 15:51:12.739296 run osmo-stp_10.42.42.5(pid=2002): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2002)] 15:51:12.870604 run osmo-stp_10.42.42.5(pid=2002): stdout: | (launched: 2022-12-13_15:51:11.507561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:13.002597 run osmo-stp_10.42.42.5(pid=2002): stderr: | [0;m[38;5;43m20221213155111679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155111679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155111679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155111680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155111680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155111680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155111680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:13.132512 run osmo-stp_10.42.42.5(pid=2002): stdout: | (launched: 2022-12-13_15:51:11.507561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:13.257522 run osmo-stp_10.42.42.5(pid=2002): stderr: | [0;m[38;5;43m20221213155111679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155111679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155111679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155111680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155111680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155111680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155111680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:13.406016 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2002): Process ended prematurely: osmo-stp_10.42.42.5(pid=2002) [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2002)] [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:51:13.414967 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:51:13.441690 run osmo-hlr_10.42.42.2(pid=1999): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1999)] 15:51:13.489462 run osmo-hlr_10.42.42.2(pid=1999): stdout: | (launched: 2022-12-13_15:51:10.533582) 15:51:13.538954 run osmo-hlr_10.42.42.2(pid=1999): stderr: | [0;m[1;31m20221213155110709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155110709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155110709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155110709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155110709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155110709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155110722 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155110730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155110730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155110730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:13.608360 run osmo-msc_10.42.42.6(pid=2005): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2005)] 15:51:13.656113 run osmo-msc_10.42.42.6(pid=2005): stdout: | (launched: 2022-12-13_15:51:12.505680) 15:51:13.705711 run osmo-msc_10.42.42.6(pid=2005): stderr: | [0;m[38;5;43m20221213155112778 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155112778 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fce6700ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155112778 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155112778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155112778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155112779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155112780 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155112781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155112781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155112781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:51:13.755600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1998): Terminating (SIGTERM) 15:51:13.795417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2001): Terminating (SIGTERM) 15:51:13.835363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2004): Terminating (SIGTERM) 15:51:13.876047 --- ParallelTerminationStrategy: PID 1998 died... 15:51:13.895497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1998): Terminated: ok {rc=0} 15:51:13.939968 --- ParallelTerminationStrategy: PID 2001 died... 15:51:13.958792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2001): Terminated: ok {rc=0} 15:51:14.003036 --- ParallelTerminationStrategy: PID 2004 died... 15:51:14.021877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2004): Terminated: ok {rc=0} 15:51:14.108427 bus /sierra_3: Setting Powered False 15:51:15.208339 bus /sierra_3: Setting Powered False 15:51:16.327480 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:51:17.482980 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:17.494679 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:51:17.553223 tst mo_mt_call_osmux.py: using LAC 34645 15:51:17.677438 tst mo_mt_call_osmux.py: using RAC 220 15:51:17.809881 tst mo_mt_call_osmux.py: using CellId 34645 15:51:17.942220 tst mo_mt_call_osmux.py: using BVCI 34646 15:51:18.065837 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:18.077806 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:18.089471 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:18.100722 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:18.112348 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:18.124064 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:51:18.240844 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:51:18.360670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:18.842814 run create_hlr_db(pid=2007): Launched 15:51:18.971368 bus /sierra_2: Setting Powered False 15:51:20.032817 run create_hlr_db(pid=2007): Terminated: ok {rc=0} 15:51:20.467957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2009): Launched 15:51:20.782232 run osmo-hlr_10.42.42.2(pid=2010): Launched 15:51:20.902102 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:21.439038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2012): Launched 15:51:21.751340 run osmo-stp_10.42.42.5(pid=2013): Launched 15:51:21.870252 run osmo-msc_10.42.42.6: Starting osmo-msc 15:51:22.439290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2015): Launched 15:51:22.753446 run osmo-msc_10.42.42.6(pid=2016): Launched 15:51:22.927818 run osmo-stp_10.42.42.5(pid=2013): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2013)] 15:51:23.059089 run osmo-stp_10.42.42.5(pid=2013): stdout: | (launched: 2022-12-13_15:51:21.693279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:23.190541 run osmo-stp_10.42.42.5(pid=2013): stderr: | [0;m[38;5;43m20221213155121862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155121863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155121863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155121863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155121864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155121864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155121864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:23.319354 run osmo-stp_10.42.42.5(pid=2013): stdout: | (launched: 2022-12-13_15:51:21.693279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:23.442869 run osmo-stp_10.42.42.5(pid=2013): stderr: | [0;m[38;5;43m20221213155121862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155121863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155121863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155121863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155121864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155121864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155121864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:23.590873 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2013): Process ended prematurely: osmo-stp_10.42.42.5(pid=2013) [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2013)] [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:51:23.599854 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:51:23.626542 run osmo-hlr_10.42.42.2(pid=2010): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2010)] 15:51:23.674482 run osmo-hlr_10.42.42.2(pid=2010): stdout: | (launched: 2022-12-13_15:51:20.723987) 15:51:23.724093 run osmo-hlr_10.42.42.2(pid=2010): stderr: | [0;m[1;31m20221213155120899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155120899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155120899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155120899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155120899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155120900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155120911 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155120920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155120920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155120920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:23.793636 run osmo-msc_10.42.42.6(pid=2016): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2016)] 15:51:23.841779 run osmo-msc_10.42.42.6(pid=2016): stdout: | (launched: 2022-12-13_15:51:22.694956) 15:51:23.891332 run osmo-msc_10.42.42.6(pid=2016): stderr: | [0;m[38;5;43m20221213155122967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155122967 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fde8fc05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155122967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155122967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155122968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155122968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155122970 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155122970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155122970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155122970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:51:23.941360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2009): Terminating (SIGTERM) 15:51:23.981260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2012): Terminating (SIGTERM) 15:51:24.021336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2015): Terminating (SIGTERM) 15:51:24.061602 --- ParallelTerminationStrategy: PID 2009 died... 15:51:24.080640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2009): Terminated: ok {rc=0} 15:51:24.125233 --- ParallelTerminationStrategy: PID 2012 died... 15:51:24.144037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2012): Terminated: ok {rc=0} 15:51:24.188241 --- ParallelTerminationStrategy: PID 2015 died... 15:51:24.207188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2015): Terminated: ok {rc=0} 15:51:24.293722 bus /sierra_3: Setting Powered False 15:51:25.394105 bus /sierra_3: Setting Powered False 15:51:26.511393 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 emergency:oc2g --------------------------------------------------------------------- 15:51:27.742694 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:51:27.747079 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 15:51:27.767490 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 15:51:27.794060 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 15:51:27.881310 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 15:51:27.901963 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 15:51:27.928530 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 15:51:28.509086 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2391 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 15:51:28.514053 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:28.524601 tst emergency:oc2g: Using 1 x bts (candidates: 1) 15:51:28.561352 tst emergency_mo_mt_call.py: using LAC 34646 15:51:28.680129 tst emergency_mo_mt_call.py: using RAC 221 15:51:28.798355 tst emergency_mo_mt_call.py: using CellId 34646 15:51:28.918093 tst emergency_mo_mt_call.py: using BVCI 34647 15:51:29.029385 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:29.040015 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:29.050642 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:29.061091 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:29.071610 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:29.082576 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:51:29.199277 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:51:29.321969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:29.832542 run create_hlr_db(pid=2021): Launched 15:51:29.959582 bus /sierra_2: Setting Powered False 15:51:31.042971 run create_hlr_db(pid=2021): Terminated: ok {rc=0} 15:51:31.527124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2023): Launched 15:51:31.860757 run osmo-hlr_10.42.42.2(pid=2024): Launched 15:51:32.103253 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:32.651082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2026): Launched 15:51:32.958870 run osmo-stp_10.42.42.5(pid=2027): Launched 15:51:33.086030 tst emergency_mo_mt_call.py: using MSISDN 8212 15:51:33.251605 run osmo-msc_10.42.42.6: Starting osmo-msc 15:51:33.801959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2029): Launched 15:51:34.110352 run osmo-msc_10.42.42.6(pid=2030): Launched 15:51:34.281621 run osmo-stp_10.42.42.5(pid=2027): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2027)] 15:51:34.410436 run osmo-stp_10.42.42.5(pid=2027): stdout: | (launched: 2022-12-13_15:51:32.901253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:34.539003 run osmo-stp_10.42.42.5(pid=2027): stderr: | [0;m[38;5;43m20221213155133069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155133070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155133070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155133070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155133071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155133071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155133071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:34.665899 run osmo-stp_10.42.42.5(pid=2027): stdout: | (launched: 2022-12-13_15:51:32.901253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:34.787040 run osmo-stp_10.42.42.5(pid=2027): stderr: | [0;m[38;5;43m20221213155133069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155133070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155133070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155133070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155133071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155133071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155133071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:34.932080 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=2027): Process ended prematurely: osmo-stp_10.42.42.5(pid=2027) [trial-2391↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2027)] [trial-2391↪emergency:oc2g↪emergency_mo_mt_call.py:19] 15:51:34.940291 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 15:51:34.966597 run osmo-hlr_10.42.42.2(pid=2024): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2024)] 15:51:35.015207 run osmo-hlr_10.42.42.2(pid=2024): stdout: | (launched: 2022-12-13_15:51:31.798700) 15:51:35.066177 run osmo-hlr_10.42.42.2(pid=2024): stderr: | [0;m[1;31m20221213155132151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155132152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155132152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155132152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155132152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155132152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155132182 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155132206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155132206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155132206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:35.135985 run osmo-msc_10.42.42.6(pid=2030): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2030)] 15:51:35.184059 run osmo-msc_10.42.42.6(pid=2030): stdout: | (launched: 2022-12-13_15:51:34.052598) 15:51:35.233989 run osmo-msc_10.42.42.6(pid=2030): stderr: | [0;m[38;5;43m20221213155134325 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155134325 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa394abbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155134325 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155134325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155134325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155134326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155134327 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155134328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155134328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155134328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:51:35.284104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2023): Terminating (SIGTERM) 15:51:35.324442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2026): Terminating (SIGTERM) 15:51:35.364613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2029): Terminating (SIGTERM) 15:51:35.405072 --- ParallelTerminationStrategy: PID 2023 died... 15:51:35.424543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2023): Terminated: ok {rc=0} 15:51:35.469095 --- ParallelTerminationStrategy: PID 2026 died... 15:51:35.488017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2026): Terminated: ok {rc=0} 15:51:35.532333 --- ParallelTerminationStrategy: PID 2029 died... 15:51:35.551428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2029): Terminated: ok {rc=0} 15:51:35.634944 bus /sierra_3: Setting Powered False 15:51:36.733376 bus /sierra_3: Setting Powered False 15:51:37.849649 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 15:51:38.937234 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:38.949423 tst emergency:oc2g: Using 1 x bts (candidates: 1) 15:51:38.988477 tst emergency_preemptive_call.py: using LAC 34647 15:51:39.119614 tst emergency_preemptive_call.py: using RAC 222 15:51:39.241573 tst emergency_preemptive_call.py: using CellId 34647 15:51:39.361181 tst emergency_preemptive_call.py: using BVCI 34648 15:51:39.471804 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:39.482616 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:39.493132 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:39.503586 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:39.514111 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:51:39.524530 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:51:39.646340 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:51:39.767984 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:51:39.886610 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:51:40.004766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:40.481867 run create_hlr_db(pid=2032): Launched 15:51:40.608029 bus /sierra_2: Setting Powered False 15:51:41.669569 run create_hlr_db(pid=2032): Terminated: ok {rc=0} 15:51:42.118160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2034): Launched 15:51:42.449109 run osmo-hlr_10.42.42.2(pid=2035): Launched 15:51:42.574974 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:43.146241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2037): Launched 15:51:43.476494 run osmo-stp_10.42.42.5(pid=2038): Launched 15:51:43.613138 tst emergency_preemptive_call.py: using MSISDN 8213 15:51:43.783392 run osmo-msc_10.42.42.6: Starting osmo-msc 15:51:44.373817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2040): Launched 15:51:44.703123 run osmo-msc_10.42.42.6(pid=2041): Launched 15:51:44.887098 run osmo-stp_10.42.42.5(pid=2038): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2038)] 15:51:45.025854 run osmo-stp_10.42.42.5(pid=2038): stdout: | (launched: 2022-12-13_15:51:43.415892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:45.165181 run osmo-stp_10.42.42.5(pid=2038): stderr: | [0;m[38;5;43m20221213155143604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155143604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155143604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155143605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155143606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155143606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155143606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:45.302438 run osmo-stp_10.42.42.5(pid=2038): stdout: | (launched: 2022-12-13_15:51:43.415892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:45.433324 run osmo-stp_10.42.42.5(pid=2038): stderr: | [0;m[38;5;43m20221213155143604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155143604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155143604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155143605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155143606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155143606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155143606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:45.589582 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2038): Process ended prematurely: osmo-stp_10.42.42.5(pid=2038) [trial-2391↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2038)] [trial-2391↪emergency:oc2g↪emergency_preemptive_call.py:32] 15:51:45.598600 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 15:51:45.626866 run osmo-hlr_10.42.42.2(pid=2035): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2035)] 15:51:45.678422 run osmo-hlr_10.42.42.2(pid=2035): stdout: | (launched: 2022-12-13_15:51:42.388216) 15:51:45.732169 run osmo-hlr_10.42.42.2(pid=2035): stderr: | [0;m[1;31m20221213155142585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155142585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155142585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155142585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155142585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155142585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155142597 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155142607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155142607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155142607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:45.806160 run osmo-msc_10.42.42.6(pid=2041): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2041)] 15:51:45.862625 run osmo-msc_10.42.42.6(pid=2041): stdout: | (launched: 2022-12-13_15:51:44.642186) 15:51:45.936247 run osmo-msc_10.42.42.6(pid=2041): stderr: | [0;m[38;5;43m20221213155144962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155144962 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8260da7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155144962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155144962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155144962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155144962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155144964 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155144965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155144965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155144965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:51:45.991429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2034): Terminating (SIGTERM) 15:51:46.038029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2037): Terminating (SIGTERM) 15:51:46.083117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2040): Terminating (SIGTERM) 15:51:46.129861 --- ParallelTerminationStrategy: PID 2034 died... 15:51:46.152323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2034): Terminated: ok {rc=0} 15:51:46.202273 --- ParallelTerminationStrategy: PID 2037 died... 15:51:46.224082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2037): Terminated: ok {rc=0} 15:51:46.273543 --- ParallelTerminationStrategy: PID 2040 died... 15:51:46.295645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2040): Terminated: ok {rc=0} 15:51:46.388801 bus /sierra_9: Setting Powered False 15:51:47.489518 bus /sierra_9: Setting Powered False 15:51:48.606493 bus /sierra_8: Setting Powered False 15:51:49.706749 bus /sierra_8: Setting Powered False 15:51:50.823064 bus /sierra_3: Setting Powered False 15:51:51.923526 bus /sierra_3: Setting Powered False 15:51:53.039424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:oc2g --------------------------------------------------------------------- 15:51:54.300355 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:51:54.304522 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 15:51:54.325186 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 15:51:54.364363 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 15:51:54.452076 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 15:51:54.473856 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 15:51:54.515554 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 15:51:55.103882 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 15:51:55.159418 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:55.170663 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:51:55.207089 tst cs_paging_gprs_active.py: using LAC 34648 15:51:55.339174 tst cs_paging_gprs_active.py: using RAC 223 15:51:55.475004 tst cs_paging_gprs_active.py: using CellId 34648 15:51:55.606561 tst cs_paging_gprs_active.py: using BVCI 34649 15:51:55.728418 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:55.739507 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:55.750455 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:55.761293 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:55.772358 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:55.783545 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:55.794796 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:55.806222 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:55.817708 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:51:55.936547 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:51:56.059574 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:51:56.286191 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:56.622846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2046): Launched 15:51:56.916663 run iperf3-srv_10.42.42.10(pid=2047): Launched 15:51:57.043341 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:51:57.271235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:57.609817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2048): Launched 15:51:57.903517 run iperf3-srv_10.42.42.10(pid=2049): Launched 15:51:58.030148 tst cs_paging_gprs_active.py:38: start network... 15:51:58.258009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:58.777982 run create_hlr_db(pid=2050): Launched 15:51:58.906807 bus /sierra_2: Setting Powered False 15:51:59.972610 run create_hlr_db(pid=2050): Terminated: ok {rc=0} 15:52:00.420626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2052): Launched 15:52:00.735247 run osmo-hlr_10.42.42.2(pid=2053): Launched 15:52:00.905643 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:01.559197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2055): Launched 15:52:01.915165 run osmo-stp_10.42.42.5(pid=2056): Launched 15:52:02.196101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:02.774986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2058): Launched 15:52:02.904079 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:03.189338 run patchelf(pid=2059): Launched 15:52:03.379088 run osmo-stp_10.42.42.5(pid=2056): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2056)] 15:52:03.521310 run osmo-stp_10.42.42.5(pid=2056): stdout: | (launched: 2022-12-13_15:52:01.848754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:03.664765 run osmo-stp_10.42.42.5(pid=2056): stderr: | [0;m[38;5;43m20221213155202038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155202038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155202038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155202039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155202039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155202039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155202039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:03.808615 run osmo-stp_10.42.42.5(pid=2056): stdout: | (launched: 2022-12-13_15:52:01.848754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:03.945745 run osmo-stp_10.42.42.5(pid=2056): stderr: | [0;m[38;5;43m20221213155202038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155202038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155202038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155202039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155202039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155202039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155202039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:04.108909 run patchelf(pid=2059): Terminating (SIGINT) 15:52:04.297676 run patchelf(pid=2059): Terminated: ok {rc=0} 15:52:04.433622 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2056): Process ended prematurely: osmo-stp_10.42.42.5(pid=2056) [trial-2391↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2056)] [trial-2391↪gprs:oc2g↪cs_paging_gprs_active.py:38] 15:52:04.443982 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 15:52:04.472839 run osmo-hlr_10.42.42.2(pid=2053): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2053)] 15:52:04.524447 run osmo-hlr_10.42.42.2(pid=2053): stdout: | (launched: 2022-12-13_15:52:00.676889) 15:52:04.577641 run osmo-hlr_10.42.42.2(pid=2053): stderr: | [0;m[1;31m20221213155200862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155200862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155200862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155200862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155200862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155200862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155200883 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155200892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155200892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155200892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:04.630837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2046): Terminating (SIGTERM) 15:52:04.673375 run iperf3-srv_10.42.42.10(pid=2047): Terminating (SIGTERM) 15:52:04.716040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2048): Terminating (SIGTERM) 15:52:04.759301 run iperf3-srv_10.42.42.10(pid=2049): Terminating (SIGTERM) 15:52:04.802244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2052): Terminating (SIGTERM) 15:52:04.845054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2055): Terminating (SIGTERM) 15:52:04.887919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2058): Terminating (SIGTERM) 15:52:04.931471 --- ParallelTerminationStrategy: PID 2046 died... 15:52:04.951931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2046): Terminated: ok {rc=0} 15:52:04.999406 --- ParallelTerminationStrategy: PID 2047 died... 15:52:05.019787 run iperf3-srv_10.42.42.10(pid=2047): Terminated {rc=256} 15:52:05.067093 --- ParallelTerminationStrategy: PID 2048 died... 15:52:05.087228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2048): Terminated: ok {rc=0} 15:52:05.134374 --- ParallelTerminationStrategy: PID 2049 died... 15:52:05.154635 run iperf3-srv_10.42.42.10(pid=2049): Terminated {rc=256} 15:52:05.201371 --- ParallelTerminationStrategy: PID 2052 died... 15:52:05.221449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2052): Terminated: ok {rc=0} 15:52:05.268319 --- ParallelTerminationStrategy: PID 2055 died... 15:52:05.288644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2055): Terminated: ok {rc=0} 15:52:05.335653 --- ParallelTerminationStrategy: PID 2058 died... 15:52:05.355714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2058): Terminated: ok {rc=0} 15:52:05.445651 bus /gobi_0: Setting Powered False 15:52:06.545958 bus /gobi_0: Setting Powered False 15:52:07.662939 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g iperf3.py ---------------------------------------------- 15:52:08.814957 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:08.826651 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:52:08.862796 tst iperf3.py: using LAC 34649 15:52:08.995614 tst iperf3.py: using RAC 224 15:52:09.129365 tst iperf3.py: using CellId 34649 15:52:09.259595 tst iperf3.py: using BVCI 34650 15:52:09.382191 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:09.393157 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:09.404005 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:09.414872 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:09.426113 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:09.437236 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:09.448449 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:09.459623 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:09.470989 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:52:09.592188 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:52:09.802555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:10.116409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2060): Launched 15:52:10.390378 run iperf3-srv_10.42.42.10(pid=2061): Launched 15:52:10.509649 tst iperf3.py:8: start network... 15:52:10.717661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:11.200782 run create_hlr_db(pid=2062): Launched 15:52:11.331928 bus /gobi_6: Setting Powered False 15:52:12.397383 run create_hlr_db(pid=2062): Terminated: ok {rc=0} 15:52:12.864176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2064): Launched 15:52:13.201067 run osmo-hlr_10.42.42.2(pid=2065): Launched 15:52:13.331401 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:13.909722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2067): Launched 15:52:14.247593 run osmo-stp_10.42.42.5(pid=2068): Launched 15:52:14.370748 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:14.911185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2070): Launched 15:52:15.032926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:15.297704 run patchelf(pid=2071): Launched 15:52:15.473094 run osmo-stp_10.42.42.5(pid=2068): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2068)] 15:52:15.604535 run osmo-stp_10.42.42.5(pid=2068): stdout: | (launched: 2022-12-13_15:52:14.186019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:15.738354 run osmo-stp_10.42.42.5(pid=2068): stderr: | [0;m[38;5;43m20221213155214359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155214359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155214360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155214360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155214361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155214361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155214361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:15.880023 run osmo-stp_10.42.42.5(pid=2068): stdout: | (launched: 2022-12-13_15:52:14.186019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:16.025813 run osmo-stp_10.42.42.5(pid=2068): stderr: | [0;m[38;5;43m20221213155214359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155214359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155214360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155214360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155214361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155214361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155214361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:16.196650 run patchelf(pid=2071): Terminating (SIGINT) 15:52:16.380455 run patchelf(pid=2071): Terminated: ok {rc=0} 15:52:16.510076 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2068): Process ended prematurely: osmo-stp_10.42.42.5(pid=2068) [trial-2391↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2068)] [trial-2391↪gprs:oc2g↪iperf3.py:8] 15:52:16.520308 tst iperf3.py:8: Test FAILED (7.7 sec) 15:52:16.548529 run osmo-hlr_10.42.42.2(pid=2065): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2065)] 15:52:16.598004 run osmo-hlr_10.42.42.2(pid=2065): stdout: | (launched: 2022-12-13_15:52:13.139345) 15:52:16.648727 run osmo-hlr_10.42.42.2(pid=2065): stderr: | [0;m[1;31m20221213155213338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155213338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155213338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155213338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155213338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155213338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155213350 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155213359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155213359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155213359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:16.699606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2060): Terminating (SIGTERM) 15:52:16.740860 run iperf3-srv_10.42.42.10(pid=2061): Terminating (SIGTERM) 15:52:16.783211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2064): Terminating (SIGTERM) 15:52:16.824836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2067): Terminating (SIGTERM) 15:52:16.867939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2070): Terminating (SIGTERM) 15:52:16.910931 --- ParallelTerminationStrategy: PID 2060 died... 15:52:16.930777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2060): Terminated: ok {rc=0} 15:52:16.975825 --- ParallelTerminationStrategy: PID 2061 died... 15:52:16.995241 run iperf3-srv_10.42.42.10(pid=2061): Terminated {rc=256} 15:52:17.039891 --- ParallelTerminationStrategy: PID 2064 died... 15:52:17.059336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2064): Terminated: ok {rc=0} 15:52:17.104232 --- ParallelTerminationStrategy: PID 2067 died... 15:52:17.123601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2067): Terminated: ok {rc=0} 15:52:17.168191 --- ParallelTerminationStrategy: PID 2070 died... 15:52:17.187605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2070): Terminated: ok {rc=0} 15:52:17.271911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g iperf3m4.py ---------------------------------------------- 15:52:18.423547 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:18.435753 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:52:18.472076 tst iperf3m4.py: using LAC 34650 15:52:18.603738 tst iperf3m4.py: using RAC 225 15:52:18.736615 tst iperf3m4.py: using CellId 34650 15:52:18.869547 tst iperf3m4.py: using BVCI 34651 15:52:18.991873 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:19.003042 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:19.014162 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:19.025228 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:19.036373 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:19.047646 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:19.059196 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:19.070800 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:19.082315 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:52:19.205481 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:52:19.327621 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:52:19.449705 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:52:19.568013 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:52:19.778978 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:20.095226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2072): Launched 15:52:20.371054 run iperf3-srv_10.42.42.10(pid=2073): Launched 15:52:20.490015 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:52:20.699763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:21.014784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2074): Launched 15:52:21.289459 run iperf3-srv_10.42.42.10(pid=2075): Launched 15:52:21.406769 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:52:21.615181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:21.927965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2076): Launched 15:52:22.202997 run iperf3-srv_10.42.42.10(pid=2077): Launched 15:52:22.321981 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:52:22.529809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:22.843261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2078): Launched 15:52:23.118748 run iperf3-srv_10.42.42.10(pid=2079): Launched 15:52:23.235844 tst iperf3m4.py:8: start network... 15:52:23.444728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:23.930616 run create_hlr_db(pid=2080): Launched 15:52:24.061464 bus /gobi_6: Setting Powered False 15:52:25.123376 run create_hlr_db(pid=2080): Terminated: ok {rc=0} 15:52:25.581462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2082): Launched 15:52:25.918587 run osmo-hlr_10.42.42.2(pid=2083): Launched 15:52:26.047533 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:26.629333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2085): Launched 15:52:26.967680 run osmo-stp_10.42.42.5(pid=2086): Launched 15:52:27.097574 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:27.683632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2088): Launched 15:52:27.814065 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:28.102200 run patchelf(pid=2089): Launched 15:52:28.292631 run osmo-stp_10.42.42.5(pid=2086): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2086)] 15:52:28.435054 run osmo-stp_10.42.42.5(pid=2086): stdout: | (launched: 2022-12-13_15:52:26.905264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:28.579370 run osmo-stp_10.42.42.5(pid=2086): stderr: | [0;m[38;5;43m20221213155227096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155227096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155227097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155227097 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155227098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155227098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155227098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:28.723821 run osmo-stp_10.42.42.5(pid=2086): stdout: | (launched: 2022-12-13_15:52:26.905264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:28.861621 run osmo-stp_10.42.42.5(pid=2086): stderr: | [0;m[38;5;43m20221213155227096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155227096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155227097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155227097 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155227098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155227098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155227098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:29.025062 run patchelf(pid=2089): Terminating (SIGINT) 15:52:29.215146 run patchelf(pid=2089): Terminated: ok {rc=0} 15:52:29.352311 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2086): Process ended prematurely: osmo-stp_10.42.42.5(pid=2086) [trial-2391↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2086)] [trial-2391↪gprs:oc2g↪iperf3m4.py:8] 15:52:29.362770 tst iperf3m4.py:8: Test FAILED (11.0 sec) 15:52:29.391884 run osmo-hlr_10.42.42.2(pid=2083): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2083)] 15:52:29.442750 run osmo-hlr_10.42.42.2(pid=2083): stdout: | (launched: 2022-12-13_15:52:25.856690) 15:52:29.495249 run osmo-hlr_10.42.42.2(pid=2083): stderr: | [0;m[1;31m20221213155226052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155226052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155226052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155226052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155226052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155226052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155226064 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155226072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155226073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155226073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:29.548001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2072): Terminating (SIGTERM) 15:52:29.590382 run iperf3-srv_10.42.42.10(pid=2073): Terminating (SIGTERM) 15:52:29.633327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2074): Terminating (SIGTERM) 15:52:29.675638 run iperf3-srv_10.42.42.10(pid=2075): Terminating (SIGTERM) 15:52:29.718001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2076): Terminating (SIGTERM) 15:52:29.760405 run iperf3-srv_10.42.42.10(pid=2077): Terminating (SIGTERM) 15:52:29.802663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2078): Terminating (SIGTERM) 15:52:29.845477 run iperf3-srv_10.42.42.10(pid=2079): Terminating (SIGTERM) 15:52:29.887768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2082): Terminating (SIGTERM) 15:52:29.930288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2085): Terminating (SIGTERM) 15:52:29.973092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2088): Terminating (SIGTERM) 15:52:30.015891 --- ParallelTerminationStrategy: PID 2072 died... 15:52:30.036527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2072): Terminated: ok {rc=0} 15:52:30.083722 --- ParallelTerminationStrategy: PID 2073 died... 15:52:30.103856 run iperf3-srv_10.42.42.10(pid=2073): Terminated {rc=256} 15:52:30.150621 --- ParallelTerminationStrategy: PID 2074 died... 15:52:30.170730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2074): Terminated: ok {rc=0} 15:52:30.217458 --- ParallelTerminationStrategy: PID 2075 died... 15:52:30.237407 run iperf3-srv_10.42.42.10(pid=2075): Terminated {rc=256} 15:52:30.284017 --- ParallelTerminationStrategy: PID 2076 died... 15:52:30.304021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2076): Terminated: ok {rc=0} 15:52:30.350604 --- ParallelTerminationStrategy: PID 2077 died... 15:52:30.370770 run iperf3-srv_10.42.42.10(pid=2077): Terminated {rc=256} 15:52:30.417422 --- ParallelTerminationStrategy: PID 2078 died... 15:52:30.437488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2078): Terminated: ok {rc=0} 15:52:30.484294 --- ParallelTerminationStrategy: PID 2079 died... 15:52:30.504509 run iperf3-srv_10.42.42.10(pid=2079): Terminated {rc=256} 15:52:30.551318 --- ParallelTerminationStrategy: PID 2082 died... 15:52:30.571532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2082): Terminated: ok {rc=0} 15:52:30.618383 --- ParallelTerminationStrategy: PID 2085 died... 15:52:30.638595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2085): Terminated: ok {rc=0} 15:52:30.685480 --- ParallelTerminationStrategy: PID 2088 died... 15:52:30.705660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2088): Terminated: ok {rc=0} 15:52:30.794873 bus /gobi_4: Setting Powered False 15:52:31.904873 bus /gobi_4: Setting Powered False 15:52:33.023234 bus /gobi_1: Setting Powered False 15:52:34.122447 bus /gobi_1: Setting Powered False 15:52:35.238632 bus /gobi_0: Setting Powered False 15:52:36.337917 bus /gobi_0: Setting Powered False 15:52:37.459322 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g ping.py ---------------------------------------------- 15:52:38.562725 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:38.574170 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:52:38.610092 tst ping.py: using LAC 34651 15:52:38.737849 tst ping.py: using RAC 226 15:52:38.867545 tst ping.py: using CellId 34651 15:52:38.992366 tst ping.py: using BVCI 34652 15:52:39.106091 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:39.116735 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:39.127440 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:39.138099 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:39.148612 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:39.159489 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:39.170544 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:39.181474 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:52:39.297996 tst ping.py:19: start network... 15:52:39.506024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:39.987685 run create_hlr_db(pid=2090): Launched 15:52:40.116072 bus /gobi_6: Setting Powered False 15:52:41.182210 run create_hlr_db(pid=2090): Terminated: ok {rc=0} 15:52:41.646321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2092): Launched 15:52:41.982317 run osmo-hlr_10.42.42.2(pid=2093): Launched 15:52:42.112114 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:42.689575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2095): Launched 15:52:43.024555 run osmo-stp_10.42.42.5(pid=2096): Launched 15:52:43.153805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:43.728264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2098): Launched 15:52:43.857857 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:44.140285 run patchelf(pid=2099): Launched 15:52:44.327428 run osmo-stp_10.42.42.5(pid=2096): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2096)] 15:52:44.467999 run osmo-stp_10.42.42.5(pid=2096): stdout: | (launched: 2022-12-13_15:52:42.962864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:44.610455 run osmo-stp_10.42.42.5(pid=2096): stderr: | [0;m[38;5;43m20221213155243156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155243156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155243156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155243157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155243157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155243157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155243157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:44.753317 run osmo-stp_10.42.42.5(pid=2096): stdout: | (launched: 2022-12-13_15:52:42.962864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:44.889172 run osmo-stp_10.42.42.5(pid=2096): stderr: | [0;m[38;5;43m20221213155243156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155243156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155243156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155243157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155243157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155243157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155243157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:45.050746 run patchelf(pid=2099): Terminating (SIGINT) 15:52:45.238522 run patchelf(pid=2099): Terminated: ok {rc=0} 15:52:45.373407 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2096): Process ended prematurely: osmo-stp_10.42.42.5(pid=2096) [trial-2391↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2096)] [trial-2391↪gprs:oc2g↪ping.py:22] 15:52:45.383319 tst ping.py:22: Test FAILED (6.8 sec) 15:52:45.412148 run osmo-hlr_10.42.42.2(pid=2093): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2093)] 15:52:45.463812 run osmo-hlr_10.42.42.2(pid=2093): stdout: | (launched: 2022-12-13_15:52:41.920018) 15:52:45.517503 run osmo-hlr_10.42.42.2(pid=2093): stderr: | [0;m[1;31m20221213155242120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155242120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155242120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155242120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155242120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155242120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155242133 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155242141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155242141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155242141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:45.571060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2092): Terminating (SIGTERM) 15:52:45.613917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2095): Terminating (SIGTERM) 15:52:45.657035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2098): Terminating (SIGTERM) 15:52:45.700404 --- ParallelTerminationStrategy: PID 2092 died... 15:52:45.721295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2092): Terminated: ok {rc=0} 15:52:45.768396 --- ParallelTerminationStrategy: PID 2095 died... 15:52:45.788424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2095): Terminated: ok {rc=0} 15:52:45.841743 --- ParallelTerminationStrategy: PID 2098 died... 15:52:45.863730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2098): Terminated: ok {rc=0} 15:52:45.971793 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 15:52:47.057865 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:47.070376 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:52:47.110062 tst ping_idle_ping.py: using LAC 34652 15:52:47.280222 tst ping_idle_ping.py: using RAC 227 15:52:47.411968 tst ping_idle_ping.py: using CellId 34652 15:52:47.541923 tst ping_idle_ping.py: using BVCI 34653 15:52:47.663497 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:47.674791 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:47.686299 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:47.697353 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:47.708640 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:47.719923 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:47.731411 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:52:47.742833 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:52:47.861564 tst ping_idle_ping.py:24: start network... 15:52:48.070240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:48.555498 run create_hlr_db(pid=2100): Launched 15:52:48.684767 bus /gobi_6: Setting Powered False 15:52:49.746688 run create_hlr_db(pid=2100): Terminated: ok {rc=0} 15:52:50.201203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2102): Launched 15:52:50.538116 run osmo-hlr_10.42.42.2(pid=2103): Launched 15:52:50.666457 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:51.243640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2105): Launched 15:52:51.579095 run osmo-stp_10.42.42.5(pid=2106): Launched 15:52:51.707579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:52.283926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2108): Launched 15:52:52.414442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:52.696900 run patchelf(pid=2109): Launched 15:52:52.883834 run osmo-stp_10.42.42.5(pid=2106): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2106)] 15:52:53.024625 run osmo-stp_10.42.42.5(pid=2106): stdout: | (launched: 2022-12-13_15:52:51.516625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:53.167993 run osmo-stp_10.42.42.5(pid=2106): stderr: | [0;m[38;5;43m20221213155251712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155251713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155251713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155251713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155251714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155251714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155251714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:53.310860 run osmo-stp_10.42.42.5(pid=2106): stdout: | (launched: 2022-12-13_15:52:51.516625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:53.446981 run osmo-stp_10.42.42.5(pid=2106): stderr: | [0;m[38;5;43m20221213155251712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155251713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155251713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155251713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155251714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155251714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155251714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:53.608531 run patchelf(pid=2109): Terminating (SIGINT) 15:52:53.795855 run patchelf(pid=2109): Terminated: ok {rc=0} 15:52:53.930612 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2106): Process ended prematurely: osmo-stp_10.42.42.5(pid=2106) [trial-2391↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2106)] [trial-2391↪gprs:oc2g↪ping_idle_ping.py:27] 15:52:53.940360 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 15:52:53.969318 run osmo-hlr_10.42.42.2(pid=2103): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2103)] 15:52:54.020407 run osmo-hlr_10.42.42.2(pid=2103): stdout: | (launched: 2022-12-13_15:52:50.476125) 15:52:54.073552 run osmo-hlr_10.42.42.2(pid=2103): stderr: | [0;m[1;31m20221213155250677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155250677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155250677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155250677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155250677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155250677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155250690 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155250701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155250701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155250701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:54.126980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2102): Terminating (SIGTERM) 15:52:54.169495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2105): Terminating (SIGTERM) 15:52:54.212507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2108): Terminating (SIGTERM) 15:52:54.255533 --- ParallelTerminationStrategy: PID 2102 died... 15:52:54.276156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2102): Terminated: ok {rc=0} 15:52:54.323126 --- ParallelTerminationStrategy: PID 2105 died... 15:52:54.343334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2105): Terminated: ok {rc=0} 15:52:54.390037 --- ParallelTerminationStrategy: PID 2108 died... 15:52:54.410190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2108): Terminated: ok {rc=0} 15:52:54.498422 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 15:52:55.796607 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:52:55.802311 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 15:52:55.823486 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 15:52:55.863743 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 15:52:55.953953 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 15:52:55.975116 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 15:52:56.014987 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 15:52:56.609778 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 15:52:56.660449 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:56.671385 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:52:56.708303 tst cs_paging_gprs_active.py: using LAC 34653 15:52:56.831245 tst cs_paging_gprs_active.py: using RAC 228 15:52:56.954642 tst cs_paging_gprs_active.py: using CellId 34653 15:52:57.077883 tst cs_paging_gprs_active.py: using BVCI 34654 15:52:57.189871 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:57.200537 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:57.211145 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:57.221745 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:57.232146 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:57.242947 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:57.253815 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:57.264645 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:57.275901 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:52:57.400887 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:52:57.523701 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:52:57.748757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:58.082949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2114): Launched 15:52:58.373825 run iperf3-srv_10.42.42.10(pid=2115): Launched 15:52:58.500533 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:52:58.723091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:59.055187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2116): Launched 15:52:59.347683 run iperf3-srv_10.42.42.10(pid=2117): Launched 15:52:59.473666 tst cs_paging_gprs_active.py:38: start network... 15:52:59.696571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:00.211810 run create_hlr_db(pid=2118): Launched 15:53:00.339272 bus /gobi_6: Setting Powered False 15:53:01.400091 run create_hlr_db(pid=2118): Terminated: ok {rc=0} 15:53:01.851502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2120): Launched 15:53:02.182810 run osmo-hlr_10.42.42.2(pid=2121): Launched 15:53:02.357371 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:02.889570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2123): Launched 15:53:03.199628 run osmo-stp_10.42.42.5(pid=2124): Launched 15:53:03.317328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:03.850747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2126): Launched 15:53:03.971697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:04.234110 run patchelf(pid=2127): Launched 15:53:04.408615 run osmo-stp_10.42.42.5(pid=2124): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2124)] 15:53:04.539795 run osmo-stp_10.42.42.5(pid=2124): stdout: | (launched: 2022-12-13_15:53:03.142405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:04.672378 run osmo-stp_10.42.42.5(pid=2124): stderr: | [0;m[38;5;43m20221213155303313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155303313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155303313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155303314 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155303314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155303314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155303314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:04.805140 run osmo-stp_10.42.42.5(pid=2124): stdout: | (launched: 2022-12-13_15:53:03.142405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:04.931502 run osmo-stp_10.42.42.5(pid=2124): stderr: | [0;m[38;5;43m20221213155303313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155303313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155303313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155303314 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155303314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155303314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155303314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:05.081493 run patchelf(pid=2127): Terminating (SIGINT) 15:53:05.255507 run patchelf(pid=2127): Terminated: ok {rc=0} 15:53:05.381336 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2124): Process ended prematurely: osmo-stp_10.42.42.5(pid=2124) [trial-2391↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2124)] [trial-2391↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 15:53:05.391030 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 15:53:05.418180 run osmo-hlr_10.42.42.2(pid=2121): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2121)] 15:53:05.465880 run osmo-hlr_10.42.42.2(pid=2121): stdout: | (launched: 2022-12-13_15:53:02.124743) 15:53:05.515332 run osmo-hlr_10.42.42.2(pid=2121): stderr: | [0;m[1;31m20221213155302316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155302316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155302316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155302316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155302316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155302316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155302342 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155302352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155302352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155302352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:05.565185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2114): Terminating (SIGTERM) 15:53:05.604884 run iperf3-srv_10.42.42.10(pid=2115): Terminating (SIGTERM) 15:53:05.644643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2116): Terminating (SIGTERM) 15:53:05.684332 run iperf3-srv_10.42.42.10(pid=2117): Terminating (SIGTERM) 15:53:05.723814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2120): Terminating (SIGTERM) 15:53:05.763517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2123): Terminating (SIGTERM) 15:53:05.803819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2126): Terminating (SIGTERM) 15:53:05.843999 --- ParallelTerminationStrategy: PID 2114 died... 15:53:05.863119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2114): Terminated: ok {rc=0} 15:53:05.907115 --- ParallelTerminationStrategy: PID 2115 died... 15:53:05.925561 run iperf3-srv_10.42.42.10(pid=2115): Terminated {rc=256} 15:53:05.969089 --- ParallelTerminationStrategy: PID 2116 died... 15:53:05.987515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2116): Terminated: ok {rc=0} 15:53:06.031109 --- ParallelTerminationStrategy: PID 2117 died... 15:53:06.049556 run iperf3-srv_10.42.42.10(pid=2117): Terminated {rc=256} 15:53:06.093379 --- ParallelTerminationStrategy: PID 2120 died... 15:53:06.111708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2120): Terminated: ok {rc=0} 15:53:06.155353 --- ParallelTerminationStrategy: PID 2123 died... 15:53:06.173955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2123): Terminated: ok {rc=0} 15:53:06.217920 --- ParallelTerminationStrategy: PID 2126 died... 15:53:06.236788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2126): Terminated: ok {rc=0} 15:53:06.323753 bus /gobi_0: Setting Powered False 15:53:07.424726 bus /gobi_0: Setting Powered False 15:53:08.541062 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 15:53:09.688814 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:09.700377 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:53:09.738315 tst iperf3.py: using LAC 34654 15:53:09.860530 tst iperf3.py: using RAC 229 15:53:09.991054 tst iperf3.py: using CellId 34654 15:53:10.122979 tst iperf3.py: using BVCI 34655 15:53:10.245951 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:10.257444 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:10.268652 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:10.279840 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:10.291172 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:10.302694 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:10.314377 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:10.325886 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:10.337465 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:10.456816 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:53:10.664254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:10.977381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2128): Launched 15:53:11.248286 run iperf3-srv_10.42.42.10(pid=2129): Launched 15:53:11.364476 tst iperf3.py:8: start network... 15:53:11.571320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:12.052316 run create_hlr_db(pid=2130): Launched 15:53:12.180226 bus /gobi_6: Setting Powered False 15:53:13.242180 run create_hlr_db(pid=2130): Terminated: ok {rc=0} 15:53:13.692854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2132): Launched 15:53:14.027093 run osmo-hlr_10.42.42.2(pid=2133): Launched 15:53:14.156291 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:14.729296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2135): Launched 15:53:15.063388 run osmo-stp_10.42.42.5(pid=2136): Launched 15:53:15.191907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:15.762965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2138): Launched 15:53:15.910207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:16.185703 run patchelf(pid=2139): Launched 15:53:16.381488 run osmo-stp_10.42.42.5(pid=2136): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2136)] 15:53:16.525680 run osmo-stp_10.42.42.5(pid=2136): stdout: | (launched: 2022-12-13_15:53:15.002375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:16.671706 run osmo-stp_10.42.42.5(pid=2136): stderr: | [0;m[38;5;43m20221213155315194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155315194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155315194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155315195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155315195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155315195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155315196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:16.839082 run osmo-stp_10.42.42.5(pid=2136): stdout: | (launched: 2022-12-13_15:53:15.002375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:16.986820 run osmo-stp_10.42.42.5(pid=2136): stderr: | [0;m[38;5;43m20221213155315194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155315194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155315194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155315195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155315195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155315195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155315196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:17.151715 run patchelf(pid=2139): Terminating (SIGINT) 15:53:17.339293 run patchelf(pid=2139): Terminated: ok {rc=0} 15:53:17.474373 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2136): Process ended prematurely: osmo-stp_10.42.42.5(pid=2136) [trial-2391↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2136)] [trial-2391↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 15:53:17.485480 tst iperf3.py:8: Test FAILED (7.8 sec) 15:53:17.514690 run osmo-hlr_10.42.42.2(pid=2133): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2133)] 15:53:17.566675 run osmo-hlr_10.42.42.2(pid=2133): stdout: | (launched: 2022-12-13_15:53:13.966129) 15:53:17.619961 run osmo-hlr_10.42.42.2(pid=2133): stderr: | [0;m[1;31m20221213155314164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155314164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155314164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155314164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155314164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155314164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155314176 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155314185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155314185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155314185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:17.674052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2128): Terminating (SIGTERM) 15:53:17.716852 run iperf3-srv_10.42.42.10(pid=2129): Terminating (SIGTERM) 15:53:17.760194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2132): Terminating (SIGTERM) 15:53:17.803812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2135): Terminating (SIGTERM) 15:53:17.847060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2138): Terminating (SIGTERM) 15:53:17.890849 --- ParallelTerminationStrategy: PID 2128 died... 15:53:17.911926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2128): Terminated: ok {rc=0} 15:53:17.959595 --- ParallelTerminationStrategy: PID 2129 died... 15:53:17.979875 run iperf3-srv_10.42.42.10(pid=2129): Terminated {rc=256} 15:53:18.027352 --- ParallelTerminationStrategy: PID 2132 died... 15:53:18.047780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2132): Terminated: ok {rc=0} 15:53:18.095748 --- ParallelTerminationStrategy: PID 2135 died... 15:53:18.116885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2135): Terminated: ok {rc=0} 15:53:18.164703 --- ParallelTerminationStrategy: PID 2138 died... 15:53:18.185274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2138): Terminated: ok {rc=0} 15:53:18.275942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 15:53:19.428151 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:19.440461 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:53:19.481910 tst iperf3m4.py: using LAC 34655 15:53:19.615915 tst iperf3m4.py: using RAC 230 15:53:19.746088 tst iperf3m4.py: using CellId 34655 15:53:19.876717 tst iperf3m4.py: using BVCI 34656 15:53:19.997420 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:20.008721 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:20.019992 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:20.031170 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:20.043090 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:20.055136 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:20.067212 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:20.079166 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:20.091503 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:20.218232 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:20.338453 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:20.461563 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:20.580380 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:53:20.787159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:21.100421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2140): Launched 15:53:21.372202 run iperf3-srv_10.42.42.10(pid=2141): Launched 15:53:21.488646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:53:21.695029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:22.006973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2142): Launched 15:53:22.280786 run iperf3-srv_10.42.42.10(pid=2143): Launched 15:53:22.397095 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:53:22.603211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:22.914518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2144): Launched 15:53:23.185395 run iperf3-srv_10.42.42.10(pid=2145): Launched 15:53:23.301442 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:53:23.506980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:23.818159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2146): Launched 15:53:24.090678 run iperf3-srv_10.42.42.10(pid=2147): Launched 15:53:24.206933 tst iperf3m4.py:8: start network... 15:53:24.413390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:24.893057 run create_hlr_db(pid=2148): Launched 15:53:25.020797 bus /gobi_6: Setting Powered False 15:53:26.082370 run create_hlr_db(pid=2148): Terminated: ok {rc=0} 15:53:26.533984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2150): Launched 15:53:26.867181 run osmo-hlr_10.42.42.2(pid=2151): Launched 15:53:26.995709 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:27.568464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2153): Launched 15:53:27.902242 run osmo-stp_10.42.42.5(pid=2154): Launched 15:53:28.030409 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:28.601131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2156): Launched 15:53:28.730989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:29.010732 run patchelf(pid=2157): Launched 15:53:29.185697 run osmo-stp_10.42.42.5(pid=2154): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2154)] 15:53:29.316862 run osmo-stp_10.42.42.5(pid=2154): stdout: | (launched: 2022-12-13_15:53:27.841198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:29.449746 run osmo-stp_10.42.42.5(pid=2154): stderr: | [0;m[38;5;43m20221213155328030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155328030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155328030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155328031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155328031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155328031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155328031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:29.582841 run osmo-stp_10.42.42.5(pid=2154): stdout: | (launched: 2022-12-13_15:53:27.841198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:29.709321 run osmo-stp_10.42.42.5(pid=2154): stderr: | [0;m[38;5;43m20221213155328030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155328030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155328030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155328031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155328031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155328031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155328031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:29.858985 run patchelf(pid=2157): Terminating (SIGINT) 15:53:30.034117 run patchelf(pid=2157): Terminated: ok {rc=0} 15:53:30.159966 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2154): Process ended prematurely: osmo-stp_10.42.42.5(pid=2154) [trial-2391↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2154)] [trial-2391↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 15:53:30.169635 tst iperf3m4.py:8: Test FAILED (10.8 sec) 15:53:30.197290 run osmo-hlr_10.42.42.2(pid=2151): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2151)] 15:53:30.245390 run osmo-hlr_10.42.42.2(pid=2151): stdout: | (launched: 2022-12-13_15:53:26.805879) 15:53:30.295208 run osmo-hlr_10.42.42.2(pid=2151): stderr: | [0;m[1;31m20221213155327002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155327002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155327002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155327002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155327002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155327002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155327015 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155327024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155327024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155327024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:30.345852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2140): Terminating (SIGTERM) 15:53:30.386132 run iperf3-srv_10.42.42.10(pid=2141): Terminating (SIGTERM) 15:53:30.426152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2142): Terminating (SIGTERM) 15:53:30.466286 run iperf3-srv_10.42.42.10(pid=2143): Terminating (SIGTERM) 15:53:30.506397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2144): Terminating (SIGTERM) 15:53:30.546474 run iperf3-srv_10.42.42.10(pid=2145): Terminating (SIGTERM) 15:53:30.586599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2146): Terminating (SIGTERM) 15:53:30.626664 run iperf3-srv_10.42.42.10(pid=2147): Terminating (SIGTERM) 15:53:30.666592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2150): Terminating (SIGTERM) 15:53:30.706780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2153): Terminating (SIGTERM) 15:53:30.747242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2156): Terminating (SIGTERM) 15:53:30.787597 --- ParallelTerminationStrategy: PID 2140 died... 15:53:30.806881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2140): Terminated: ok {rc=0} 15:53:30.855861 --- ParallelTerminationStrategy: PID 2141 died... 15:53:30.875660 run iperf3-srv_10.42.42.10(pid=2141): Terminated {rc=256} 15:53:30.924466 --- ParallelTerminationStrategy: PID 2142 died... 15:53:30.944017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2142): Terminated: ok {rc=0} 15:53:30.990005 --- ParallelTerminationStrategy: PID 2143 died... 15:53:31.009586 run iperf3-srv_10.42.42.10(pid=2143): Terminated {rc=256} 15:53:31.056527 --- ParallelTerminationStrategy: PID 2144 died... 15:53:31.077367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2144): Terminated: ok {rc=0} 15:53:31.124367 --- ParallelTerminationStrategy: PID 2145 died... 15:53:31.145074 run iperf3-srv_10.42.42.10(pid=2145): Terminated {rc=256} 15:53:31.192517 --- ParallelTerminationStrategy: PID 2146 died... 15:53:31.213202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2146): Terminated: ok {rc=0} 15:53:31.260037 --- ParallelTerminationStrategy: PID 2147 died... 15:53:31.280670 run iperf3-srv_10.42.42.10(pid=2147): Terminated {rc=256} 15:53:31.327540 --- ParallelTerminationStrategy: PID 2150 died... 15:53:31.348385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2150): Terminated: ok {rc=0} 15:53:31.395512 --- ParallelTerminationStrategy: PID 2153 died... 15:53:31.416266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2153): Terminated: ok {rc=0} 15:53:31.464699 --- ParallelTerminationStrategy: PID 2156 died... 15:53:31.485330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2156): Terminated: ok {rc=0} 15:53:31.574335 bus /gobi_4: Setting Powered False 15:53:32.671192 bus /gobi_4: Setting Powered False 15:53:33.785391 bus /gobi_1: Setting Powered False 15:53:34.884588 bus /gobi_1: Setting Powered False 15:53:36.003359 bus /gobi_0: Setting Powered False 15:53:37.104360 bus /gobi_0: Setting Powered False 15:53:38.223621 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 15:53:39.326472 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:39.338399 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:53:39.375941 tst ping.py: using LAC 34656 15:53:39.495074 tst ping.py: using RAC 231 15:53:39.616302 tst ping.py: using CellId 34656 15:53:39.735760 tst ping.py: using BVCI 34657 15:53:39.847083 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:39.857952 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:39.868678 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:39.879337 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:39.890054 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:39.901103 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:39.911791 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:39.922915 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:40.039737 tst ping.py:19: start network... 15:53:40.243523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:40.712270 run create_hlr_db(pid=2158): Launched 15:53:40.836420 bus /gobi_6: Setting Powered False 15:53:41.897087 run create_hlr_db(pid=2158): Terminated: ok {rc=0} 15:53:42.323584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2160): Launched 15:53:42.629278 run osmo-hlr_10.42.42.2(pid=2161): Launched 15:53:42.745174 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:43.270446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2163): Launched 15:53:43.576078 run osmo-stp_10.42.42.5(pid=2164): Launched 15:53:43.692260 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:44.218828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2166): Launched 15:53:44.335947 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:44.594242 run patchelf(pid=2167): Launched 15:53:44.764330 run osmo-stp_10.42.42.5(pid=2164): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2164)] 15:53:44.893844 run osmo-stp_10.42.42.5(pid=2164): stdout: | (launched: 2022-12-13_15:53:43.519181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:45.024929 run osmo-stp_10.42.42.5(pid=2164): stderr: | [0;m[38;5;43m20221213155343689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155343689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155343689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155343689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155343690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155343690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155343690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:45.156647 run osmo-stp_10.42.42.5(pid=2164): stdout: | (launched: 2022-12-13_15:53:43.519181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:45.280904 run osmo-stp_10.42.42.5(pid=2164): stderr: | [0;m[38;5;43m20221213155343689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155343689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155343689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155343689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155343690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155343690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155343690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:45.429090 run patchelf(pid=2167): Terminating (SIGINT) 15:53:45.600032 run patchelf(pid=2167): Terminated: ok {rc=0} 15:53:45.723541 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2164): Process ended prematurely: osmo-stp_10.42.42.5(pid=2164) [trial-2391↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2164)] [trial-2391↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 15:53:45.732676 tst ping.py:22: Test FAILED (6.4 sec) 15:53:45.759675 run osmo-hlr_10.42.42.2(pid=2161): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2161)] 15:53:45.807658 run osmo-hlr_10.42.42.2(pid=2161): stdout: | (launched: 2022-12-13_15:53:42.572344) 15:53:45.857471 run osmo-hlr_10.42.42.2(pid=2161): stderr: | [0;m[1;31m20221213155342750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155342750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155342750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155342750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155342750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155342750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155342762 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155342771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155342771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155342771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:45.918809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2160): Terminating (SIGTERM) 15:53:45.959920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2163): Terminating (SIGTERM) 15:53:46.001418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2166): Terminating (SIGTERM) 15:53:46.045221 --- ParallelTerminationStrategy: PID 2160 died... 15:53:46.068416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2160): Terminated: ok {rc=0} 15:53:46.116925 --- ParallelTerminationStrategy: PID 2163 died... 15:53:46.136830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2163): Terminated: ok {rc=0} 15:53:46.182439 --- ParallelTerminationStrategy: PID 2166 died... 15:53:46.202253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2166): Terminated: ok {rc=0} 15:53:46.289622 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 15:53:47.393541 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:47.416231 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:53:47.467709 tst ping_idle_ping.py: using LAC 34657 15:53:47.649319 tst ping_idle_ping.py: using RAC 232 15:53:47.779264 tst ping_idle_ping.py: using CellId 34657 15:53:47.917135 tst ping_idle_ping.py: using BVCI 34658 15:53:48.062049 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:48.074265 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:48.090564 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:48.102521 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:48.115121 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:48.130762 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:48.148198 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:48.163269 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:48.289932 tst ping_idle_ping.py:24: start network... 15:53:48.536326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:49.139256 run create_hlr_db(pid=2363): Launched 15:53:49.328682 bus /gobi_6: Setting Powered False 15:53:50.391688 run create_hlr_db(pid=2363): Terminated: ok {rc=0} 15:53:50.875967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2439): Launched 15:53:51.204668 run osmo-hlr_10.42.42.2(pid=2441): Launched 15:53:51.454357 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:52.121326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2444): Launched 15:53:52.464086 run osmo-stp_10.42.42.5(pid=2445): Launched 15:53:52.703322 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:53.387980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2447): Launched 15:53:53.521330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:53.788120 run patchelf(pid=2448): Launched 15:53:53.978202 run osmo-stp_10.42.42.5(pid=2445): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2445)] 15:53:54.114317 run osmo-stp_10.42.42.5(pid=2445): stdout: | (launched: 2022-12-13_15:53:52.403183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:54.250483 run osmo-stp_10.42.42.5(pid=2445): stderr: | [0;m[38;5;43m20221213155352732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155352732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155352732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155352733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155352733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155352733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155352733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:54.389256 run osmo-stp_10.42.42.5(pid=2445): stdout: | (launched: 2022-12-13_15:53:52.403183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:54.518678 run osmo-stp_10.42.42.5(pid=2445): stderr: | [0;m[38;5;43m20221213155352732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155352732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155352732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155352733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155352733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155352733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155352733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:54.673495 run patchelf(pid=2448): Terminating (SIGINT) 15:53:54.851416 run patchelf(pid=2448): Terminated: ok {rc=0} 15:53:54.980813 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2445): Process ended prematurely: osmo-stp_10.42.42.5(pid=2445) [trial-2391↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2445)] [trial-2391↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 15:53:54.991086 tst ping_idle_ping.py:27: Test FAILED (7.6 sec) 15:53:55.019678 run osmo-hlr_10.42.42.2(pid=2441): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2441)] 15:53:55.069971 run osmo-hlr_10.42.42.2(pid=2441): stdout: | (launched: 2022-12-13_15:53:51.147080) 15:53:55.122330 run osmo-hlr_10.42.42.2(pid=2441): stderr: | [0;m[1;31m20221213155351444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155351444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155351444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155351444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155351444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155351444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155351461 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155351469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155351470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155351470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:55.174837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2439): Terminating (SIGTERM) 15:53:55.217098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2444): Terminating (SIGTERM) 15:53:55.260678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2447): Terminating (SIGTERM) 15:53:55.306403 --- ParallelTerminationStrategy: PID 2439 died... 15:53:55.328233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2439): Terminated: ok {rc=0} 15:53:55.375735 --- ParallelTerminationStrategy: PID 2444 died... 15:53:55.395514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2444): Terminated: ok {rc=0} 15:53:55.441578 --- ParallelTerminationStrategy: PID 2447 died... 15:53:55.461715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2447): Terminated: ok {rc=0} 15:53:55.551347 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 15:53:56.853385 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:53:56.860383 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 15:53:56.883399 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 15:53:56.925483 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 15:53:57.015484 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 15:53:57.041156 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 15:53:57.083102 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 15:53:57.672788 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 15:53:57.729793 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:57.741803 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:53:57.805880 tst cs_paging_gprs_active.py: using LAC 34658 15:53:57.933189 tst cs_paging_gprs_active.py: using RAC 233 15:53:58.058393 tst cs_paging_gprs_active.py: using CellId 34658 15:53:58.183244 tst cs_paging_gprs_active.py: using BVCI 34659 15:53:58.302059 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:58.314797 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:58.326649 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:58.339227 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:58.351406 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:58.363721 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:58.375861 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:58.387613 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:58.399607 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:53:58.522252 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:53:58.646019 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:53:58.862870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:59.192068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2454): Launched 15:53:59.496317 run iperf3-srv_10.42.42.10(pid=2455): Launched 15:53:59.633862 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:53:59.851776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:54:00.180000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2456): Launched 15:54:00.480619 run iperf3-srv_10.42.42.10(pid=2457): Launched 15:54:00.617578 tst cs_paging_gprs_active.py:38: start network... 15:54:00.844881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:01.423461 run create_hlr_db(pid=2458): Launched 15:54:01.619214 bus /gobi_6: Setting Powered False 15:54:02.718029 run create_hlr_db(pid=2458): Terminated: ok {rc=0} 15:54:03.214728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2460): Launched 15:54:03.568437 run osmo-hlr_10.42.42.2(pid=2461): Launched 15:54:03.824353 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:04.512018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2463): Launched 15:54:04.851623 run osmo-stp_10.42.42.5(pid=2464): Launched 15:54:05.101606 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:05.796109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2466): Launched 15:54:05.931987 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:06.206300 run patchelf(pid=2467): Launched 15:54:06.404915 run osmo-stp_10.42.42.5(pid=2464): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2464)] 15:54:06.542698 run osmo-stp_10.42.42.5(pid=2464): stdout: | (launched: 2022-12-13_15:54:04.787771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:06.681148 run osmo-stp_10.42.42.5(pid=2464): stderr: | [0;m[38;5;43m20221213155405119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155405119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155405119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155405120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155405120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155405120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155405120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:06.819392 run osmo-stp_10.42.42.5(pid=2464): stdout: | (launched: 2022-12-13_15:54:04.787771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:06.951500 run osmo-stp_10.42.42.5(pid=2464): stderr: | [0;m[38;5;43m20221213155405119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155405119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155405119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155405120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155405120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155405120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155405120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:07.107822 run patchelf(pid=2467): Terminating (SIGINT) 15:54:07.292110 run patchelf(pid=2467): Terminated: ok {rc=0} 15:54:07.424051 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2464): Process ended prematurely: osmo-stp_10.42.42.5(pid=2464) [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2464)] [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 15:54:07.434932 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 15:54:07.463856 run osmo-hlr_10.42.42.2(pid=2461): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2461)] 15:54:07.515901 run osmo-hlr_10.42.42.2(pid=2461): stdout: | (launched: 2022-12-13_15:54:03.505948) 15:54:07.568339 run osmo-hlr_10.42.42.2(pid=2461): stderr: | [0;m[1;31m20221213155403815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155403815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155403815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155403815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155403815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155403815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155403834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155403846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155403846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155403847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:07.620627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2454): Terminating (SIGTERM) 15:54:07.663205 run iperf3-srv_10.42.42.10(pid=2455): Terminating (SIGTERM) 15:54:07.709877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2456): Terminating (SIGTERM) 15:54:07.753137 run iperf3-srv_10.42.42.10(pid=2457): Terminating (SIGTERM) 15:54:07.798355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2460): Terminating (SIGTERM) 15:54:07.840658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2463): Terminating (SIGTERM) 15:54:07.883295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2466): Terminating (SIGTERM) 15:54:07.928581 --- ParallelTerminationStrategy: PID 2454 died... 15:54:07.949720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2454): Terminated: ok {rc=0} 15:54:07.998452 --- ParallelTerminationStrategy: PID 2455 died... 15:54:08.018820 run iperf3-srv_10.42.42.10(pid=2455): Terminated {rc=256} 15:54:08.065190 --- ParallelTerminationStrategy: PID 2456 died... 15:54:08.086662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2456): Terminated: ok {rc=0} 15:54:08.133175 --- ParallelTerminationStrategy: PID 2457 died... 15:54:08.153081 run iperf3-srv_10.42.42.10(pid=2457): Terminated {rc=256} 15:54:08.199265 --- ParallelTerminationStrategy: PID 2460 died... 15:54:08.219396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2460): Terminated: ok {rc=0} 15:54:08.266196 --- ParallelTerminationStrategy: PID 2463 died... 15:54:08.287068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2463): Terminated: ok {rc=0} 15:54:08.332779 --- ParallelTerminationStrategy: PID 2466 died... 15:54:08.353907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2466): Terminated: ok {rc=0} 15:54:08.441397 bus /gobi_0: Setting Powered False 15:54:09.540662 bus /gobi_0: Setting Powered False 15:54:10.659427 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 15:54:11.806975 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:11.818753 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:54:11.878611 tst iperf3.py: using LAC 34659 15:54:12.001177 tst iperf3.py: using RAC 234 15:54:12.124667 tst iperf3.py: using CellId 34659 15:54:12.248827 tst iperf3.py: using BVCI 34660 15:54:12.364050 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:12.375053 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:12.385794 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:12.396706 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:12.407378 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:12.418559 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:12.429857 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:12.440492 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:12.451349 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:54:12.567237 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:54:12.776127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:54:13.091598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2469): Launched 15:54:13.367316 run iperf3-srv_10.42.42.10(pid=2470): Launched 15:54:13.486555 tst iperf3.py:8: start network... 15:54:13.695657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:14.180348 run create_hlr_db(pid=2471): Launched 15:54:14.308285 bus /gobi_6: Setting Powered False 15:54:15.370041 run create_hlr_db(pid=2471): Terminated: ok {rc=0} 15:54:15.825574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2473): Launched 15:54:16.178842 run osmo-hlr_10.42.42.2(pid=2474): Launched 15:54:16.440000 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:17.097885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2476): Launched 15:54:17.420039 run osmo-stp_10.42.42.5(pid=2477): Launched 15:54:17.543691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:18.087679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2479): Launched 15:54:18.208662 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:18.473650 run patchelf(pid=2480): Launched 15:54:18.647155 run osmo-stp_10.42.42.5(pid=2477): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2477)] 15:54:18.778638 run osmo-stp_10.42.42.5(pid=2477): stdout: | (launched: 2022-12-13_15:54:17.361156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:18.912149 run osmo-stp_10.42.42.5(pid=2477): stderr: | [0;m[38;5;43m20221213155417535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155417535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155417535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155417536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155417538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155417538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155417538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:19.045798 run osmo-stp_10.42.42.5(pid=2477): stdout: | (launched: 2022-12-13_15:54:17.361156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:19.173247 run osmo-stp_10.42.42.5(pid=2477): stderr: | [0;m[38;5;43m20221213155417535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155417535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155417535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155417536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155417538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155417538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155417538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:19.323929 run patchelf(pid=2480): Terminating (SIGINT) 15:54:19.499045 run patchelf(pid=2480): Terminated: ok {rc=0} 15:54:19.625618 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2477): Process ended prematurely: osmo-stp_10.42.42.5(pid=2477) [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2477)] [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 15:54:19.635140 tst iperf3.py:8: Test FAILED (7.9 sec) 15:54:19.662351 run osmo-hlr_10.42.42.2(pid=2474): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2474)] 15:54:19.710220 run osmo-hlr_10.42.42.2(pid=2474): stdout: | (launched: 2022-12-13_15:54:16.116169) 15:54:19.760067 run osmo-hlr_10.42.42.2(pid=2474): stderr: | [0;m[1;31m20221213155416383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155416383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155416383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155416383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155416383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155416383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155416401 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155416409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155416409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155416409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:19.810182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2469): Terminating (SIGTERM) 15:54:19.850096 run iperf3-srv_10.42.42.10(pid=2470): Terminating (SIGTERM) 15:54:19.889701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2473): Terminating (SIGTERM) 15:54:19.929507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2476): Terminating (SIGTERM) 15:54:19.969710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2479): Terminating (SIGTERM) 15:54:20.010007 --- ParallelTerminationStrategy: PID 2469 died... 15:54:20.029152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2469): Terminated: ok {rc=0} 15:54:20.073455 --- ParallelTerminationStrategy: PID 2470 died... 15:54:20.092056 run iperf3-srv_10.42.42.10(pid=2470): Terminated {rc=256} 15:54:20.135905 --- ParallelTerminationStrategy: PID 2473 died... 15:54:20.154351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2473): Terminated: ok {rc=0} 15:54:20.198133 --- ParallelTerminationStrategy: PID 2476 died... 15:54:20.216636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2476): Terminated: ok {rc=0} 15:54:20.260382 --- ParallelTerminationStrategy: PID 2479 died... 15:54:20.279150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2479): Terminated: ok {rc=0} 15:54:20.367430 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 15:54:21.518843 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:21.530754 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:54:21.592833 tst iperf3m4.py: using LAC 34660 15:54:21.715583 tst iperf3m4.py: using RAC 235 15:54:21.835084 tst iperf3m4.py: using CellId 34660 15:54:21.956940 tst iperf3m4.py: using BVCI 34661 15:54:22.069634 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:22.080537 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:22.091429 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:22.102695 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:22.113539 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:22.124194 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:22.135350 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:22.146281 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:22.157399 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:54:22.279572 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:54:22.402071 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:54:22.525530 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:54:22.643744 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:54:22.853602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:54:23.168640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2481): Launched 15:54:23.445622 run iperf3-srv_10.42.42.10(pid=2482): Launched 15:54:23.563174 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:54:23.771927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:54:24.087511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2483): Launched 15:54:24.363990 run iperf3-srv_10.42.42.10(pid=2484): Launched 15:54:24.482831 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:54:24.692667 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:54:25.008735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2485): Launched 15:54:25.285300 run iperf3-srv_10.42.42.10(pid=2486): Launched 15:54:25.404350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:54:25.613444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:54:25.928591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2487): Launched 15:54:26.205589 run iperf3-srv_10.42.42.10(pid=2488): Launched 15:54:26.324924 tst iperf3m4.py:8: start network... 15:54:26.535894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:27.022732 run create_hlr_db(pid=2489): Launched 15:54:27.152613 bus /gobi_6: Setting Powered False 15:54:28.213541 run create_hlr_db(pid=2489): Terminated: ok {rc=0} 15:54:28.671505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2491): Launched 15:54:29.008129 run osmo-hlr_10.42.42.2(pid=2492): Launched 15:54:29.138442 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:29.720423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2494): Launched 15:54:30.058456 run osmo-stp_10.42.42.5(pid=2495): Launched 15:54:30.186919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:30.766461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2497): Launched 15:54:30.912863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:31.253446 run patchelf(pid=2498): Launched 15:54:31.450703 run osmo-stp_10.42.42.5(pid=2495): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2495)] 15:54:31.589911 run osmo-stp_10.42.42.5(pid=2495): stdout: | (launched: 2022-12-13_15:54:29.995936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:31.730934 run osmo-stp_10.42.42.5(pid=2495): stderr: | [0;m[38;5;43m20221213155430189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155430189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155430189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155430190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155430190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155430190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155430190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:31.869565 run osmo-stp_10.42.42.5(pid=2495): stdout: | (launched: 2022-12-13_15:54:29.995936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:32.002395 run osmo-stp_10.42.42.5(pid=2495): stderr: | [0;m[38;5;43m20221213155430189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155430189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155430189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155430190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155430190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155430190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155430190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:32.159321 run patchelf(pid=2498): Terminating (SIGINT) 15:54:32.336647 run patchelf(pid=2498): Terminated: ok {rc=0} 15:54:32.464867 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2495): Process ended prematurely: osmo-stp_10.42.42.5(pid=2495) [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2495)] [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 15:54:32.474848 tst iperf3m4.py:8: Test FAILED (11.0 sec) 15:54:32.503260 run osmo-hlr_10.42.42.2(pid=2492): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2492)] 15:54:32.552425 run osmo-hlr_10.42.42.2(pid=2492): stdout: | (launched: 2022-12-13_15:54:28.946048) 15:54:32.603270 run osmo-hlr_10.42.42.2(pid=2492): stderr: | [0;m[1;31m20221213155429147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155429147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155429147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155429147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155429147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155429147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155429159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155429170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155429170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155429170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:32.654182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2481): Terminating (SIGTERM) 15:54:32.694824 run iperf3-srv_10.42.42.10(pid=2482): Terminating (SIGTERM) 15:54:32.735322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2483): Terminating (SIGTERM) 15:54:32.776045 run iperf3-srv_10.42.42.10(pid=2484): Terminating (SIGTERM) 15:54:32.816607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2485): Terminating (SIGTERM) 15:54:32.857755 run iperf3-srv_10.42.42.10(pid=2486): Terminating (SIGTERM) 15:54:32.898767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2487): Terminating (SIGTERM) 15:54:32.939516 run iperf3-srv_10.42.42.10(pid=2488): Terminating (SIGTERM) 15:54:32.980249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2491): Terminating (SIGTERM) 15:54:33.021204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2494): Terminating (SIGTERM) 15:54:33.061917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2497): Terminating (SIGTERM) 15:54:33.103112 --- ParallelTerminationStrategy: PID 2481 died... 15:54:33.122706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2481): Terminated: ok {rc=0} 15:54:33.167913 --- ParallelTerminationStrategy: PID 2482 died... 15:54:33.187201 run iperf3-srv_10.42.42.10(pid=2482): Terminated {rc=256} 15:54:33.231983 --- ParallelTerminationStrategy: PID 2483 died... 15:54:33.251109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2483): Terminated: ok {rc=0} 15:54:33.295996 --- ParallelTerminationStrategy: PID 2484 died... 15:54:33.315238 run iperf3-srv_10.42.42.10(pid=2484): Terminated {rc=256} 15:54:33.360082 --- ParallelTerminationStrategy: PID 2485 died... 15:54:33.379214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2485): Terminated: ok {rc=0} 15:54:33.423823 --- ParallelTerminationStrategy: PID 2486 died... 15:54:33.442790 run iperf3-srv_10.42.42.10(pid=2486): Terminated {rc=256} 15:54:33.487184 --- ParallelTerminationStrategy: PID 2487 died... 15:54:33.506249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2487): Terminated: ok {rc=0} 15:54:33.550984 --- ParallelTerminationStrategy: PID 2488 died... 15:54:33.570164 run iperf3-srv_10.42.42.10(pid=2488): Terminated {rc=256} 15:54:33.614801 --- ParallelTerminationStrategy: PID 2491 died... 15:54:33.634331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2491): Terminated: ok {rc=0} 15:54:33.679033 --- ParallelTerminationStrategy: PID 2494 died... 15:54:33.698242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2494): Terminated: ok {rc=0} 15:54:33.742836 --- ParallelTerminationStrategy: PID 2497 died... 15:54:33.761949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2497): Terminated: ok {rc=0} 15:54:33.849035 bus /gobi_4: Setting Powered False 15:54:34.950834 bus /gobi_4: Setting Powered False 15:54:36.065788 bus /gobi_1: Setting Powered False 15:54:37.165827 bus /gobi_1: Setting Powered False 15:54:38.283302 bus /gobi_0: Setting Powered False 15:54:39.383942 bus /gobi_0: Setting Powered False 15:54:40.503370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 15:54:41.608057 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:41.619847 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:54:41.677169 tst ping.py: using LAC 34661 15:54:41.797309 tst ping.py: using RAC 236 15:54:41.918316 tst ping.py: using CellId 34661 15:54:42.044498 tst ping.py: using BVCI 34662 15:54:42.156486 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:42.167569 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:42.178407 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:42.189162 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:42.199921 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:42.210657 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:42.222150 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:42.233134 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:54:42.347565 tst ping.py:19: start network... 15:54:42.553521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:43.029575 run create_hlr_db(pid=2499): Launched 15:54:43.154842 bus /gobi_6: Setting Powered False 15:54:44.216401 run create_hlr_db(pid=2499): Terminated: ok {rc=0} 15:54:44.666302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2501): Launched 15:54:44.996103 run osmo-hlr_10.42.42.2(pid=2502): Launched 15:54:45.123752 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:45.696143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2504): Launched 15:54:46.037817 run osmo-stp_10.42.42.5(pid=2505): Launched 15:54:46.321919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:46.906054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2507): Launched 15:54:47.082879 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:47.380914 run patchelf(pid=2508): Launched 15:54:47.566392 run osmo-stp_10.42.42.5(pid=2505): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2505)] 15:54:47.698444 run osmo-stp_10.42.42.5(pid=2505): stdout: | (launched: 2022-12-13_15:54:45.972418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:47.832054 run osmo-stp_10.42.42.5(pid=2505): stderr: | [0;m[38;5;43m20221213155446275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155446275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155446275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155446276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155446276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155446276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155446276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:47.965427 run osmo-stp_10.42.42.5(pid=2505): stdout: | (launched: 2022-12-13_15:54:45.972418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:48.092115 run osmo-stp_10.42.42.5(pid=2505): stderr: | [0;m[38;5;43m20221213155446275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155446275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155446275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155446276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155446276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155446276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155446276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:48.242824 run patchelf(pid=2508): Terminating (SIGINT) 15:54:48.416867 run patchelf(pid=2508): Terminated: ok {rc=0} 15:54:48.542548 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2505): Process ended prematurely: osmo-stp_10.42.42.5(pid=2505) [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2505)] [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 15:54:48.551528 tst ping.py:22: Test FAILED (6.9 sec) 15:54:48.578984 run osmo-hlr_10.42.42.2(pid=2502): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2502)] 15:54:48.629234 run osmo-hlr_10.42.42.2(pid=2502): stdout: | (launched: 2022-12-13_15:54:44.934696) 15:54:48.679951 run osmo-hlr_10.42.42.2(pid=2502): stderr: | [0;m[1;31m20221213155445136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155445136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155445136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155445136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155445136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155445137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155445150 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155445158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155445158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155445158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:48.731218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2501): Terminating (SIGTERM) 15:54:48.772673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2504): Terminating (SIGTERM) 15:54:48.814338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2507): Terminating (SIGTERM) 15:54:48.856207 --- ParallelTerminationStrategy: PID 2501 died... 15:54:48.876416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2501): Terminated: ok {rc=0} 15:54:48.922192 --- ParallelTerminationStrategy: PID 2504 died... 15:54:48.941873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2504): Terminated: ok {rc=0} 15:54:48.986950 --- ParallelTerminationStrategy: PID 2507 died... 15:54:49.006561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2507): Terminated: ok {rc=0} 15:54:49.094515 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 15:54:50.184877 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:50.196825 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:54:50.254258 tst ping_idle_ping.py: using LAC 34662 15:54:50.374686 tst ping_idle_ping.py: using RAC 237 15:54:50.496544 tst ping_idle_ping.py: using CellId 34662 15:54:50.616487 tst ping_idle_ping.py: using BVCI 34663 15:54:50.727836 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:50.738940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:50.749740 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:50.760491 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:50.771225 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:50.782030 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:50.792938 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:54:50.803712 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:54:50.921714 tst ping_idle_ping.py:24: start network... 15:54:51.127977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:51.607365 run create_hlr_db(pid=2510): Launched 15:54:51.735271 bus /gobi_6: Setting Powered False 15:54:52.796916 run create_hlr_db(pid=2510): Terminated: ok {rc=0} 15:54:53.249880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2512): Launched 15:54:53.584257 run osmo-hlr_10.42.42.2(pid=2513): Launched 15:54:53.712856 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:54.284910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2515): Launched 15:54:54.617680 run osmo-stp_10.42.42.5(pid=2516): Launched 15:54:54.744407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:55.315568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2518): Launched 15:54:55.443924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:55.723778 run patchelf(pid=2519): Launched 15:54:55.907740 run osmo-stp_10.42.42.5(pid=2516): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2516)] 15:54:56.047442 run osmo-stp_10.42.42.5(pid=2516): stdout: | (launched: 2022-12-13_15:54:54.555954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:56.189873 run osmo-stp_10.42.42.5(pid=2516): stderr: | [0;m[38;5;43m20221213155454754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155454754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155454754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155454754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155454755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155454755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155454755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:56.331969 run osmo-stp_10.42.42.5(pid=2516): stdout: | (launched: 2022-12-13_15:54:54.555954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:56.466737 run osmo-stp_10.42.42.5(pid=2516): stderr: | [0;m[38;5;43m20221213155454754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155454754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155454754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155454754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155454755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155454755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155454755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:56.626708 run patchelf(pid=2519): Terminating (SIGINT) 15:54:56.811936 run patchelf(pid=2519): Terminated: ok {rc=0} 15:54:56.945619 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2516): Process ended prematurely: osmo-stp_10.42.42.5(pid=2516) [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2516)] [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 15:54:56.955453 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 15:54:56.983968 run osmo-hlr_10.42.42.2(pid=2513): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2513)] 15:54:57.035304 run osmo-hlr_10.42.42.2(pid=2513): stdout: | (launched: 2022-12-13_15:54:53.522630) 15:54:57.089445 run osmo-hlr_10.42.42.2(pid=2513): stderr: | [0;m[1;31m20221213155453723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155453723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155453723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155453723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155453723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155453723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155453736 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155453747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155453747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155453747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:57.142981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2512): Terminating (SIGTERM) 15:54:57.186130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2515): Terminating (SIGTERM) 15:54:57.229259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2518): Terminating (SIGTERM) 15:54:57.272328 --- ParallelTerminationStrategy: PID 2512 died... 15:54:57.293150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2512): Terminated: ok {rc=0} 15:54:57.340388 --- ParallelTerminationStrategy: PID 2515 died... 15:54:57.360584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2515): Terminated: ok {rc=0} 15:54:57.407646 --- ParallelTerminationStrategy: PID 2518 died... 15:54:57.428006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2518): Terminated: ok {rc=0} 15:54:57.518603 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:54:58.822836 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:54:58.829767 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:54:58.851370 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 15:54:58.892374 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 15:54:58.982882 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:54:59.004614 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 15:54:59.044936 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 15:54:59.640888 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 15:54:59.695634 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:59.707287 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:54:59.766615 tst cs_paging_gprs_active.py: using LAC 34663 15:54:59.896508 tst cs_paging_gprs_active.py: using RAC 238 15:55:00.028526 tst cs_paging_gprs_active.py: using CellId 34663 15:55:00.160374 tst cs_paging_gprs_active.py: using BVCI 34664 15:55:00.282149 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:00.293782 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:00.305570 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:00.316936 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:00.328664 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:00.340603 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:00.352607 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:00.364486 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:00.376862 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:55:00.498102 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:55:00.619269 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:55:00.832500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:55:01.158846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2523): Launched 15:55:01.452182 run iperf3-srv_10.42.42.10(pid=2524): Launched 15:55:01.586837 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:55:01.811254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:55:02.137758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2528): Launched 15:55:02.439680 run iperf3-srv_10.42.42.10(pid=2529): Launched 15:55:02.568038 tst cs_paging_gprs_active.py:38: start network... 15:55:02.795408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:03.316498 run create_hlr_db(pid=2530): Launched 15:55:03.446118 bus /gobi_6: Setting Powered False 15:55:04.511308 run create_hlr_db(pid=2530): Terminated: ok {rc=0} 15:55:04.959833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2532): Launched 15:55:05.279453 run osmo-hlr_10.42.42.2(pid=2533): Launched 15:55:05.404158 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:05.959948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2535): Launched 15:55:06.277680 run osmo-stp_10.42.42.5(pid=2536): Launched 15:55:06.399451 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:55:06.941653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2538): Launched 15:55:07.063367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:55:07.330080 run patchelf(pid=2539): Launched 15:55:07.505201 run osmo-stp_10.42.42.5(pid=2536): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2536)] 15:55:07.637907 run osmo-stp_10.42.42.5(pid=2536): stdout: | (launched: 2022-12-13_15:55:06.219150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:07.771891 run osmo-stp_10.42.42.5(pid=2536): stderr: | [0;m[38;5;43m20221213155506393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155506393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155506394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155506394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155506394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155506395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155506395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:07.906097 run osmo-stp_10.42.42.5(pid=2536): stdout: | (launched: 2022-12-13_15:55:06.219150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:08.034167 run osmo-stp_10.42.42.5(pid=2536): stderr: | [0;m[38;5;43m20221213155506393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155506393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155506394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155506394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155506394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155506395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155506395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:08.185855 run patchelf(pid=2539): Terminating (SIGINT) 15:55:08.362079 run patchelf(pid=2539): Terminated: ok {rc=0} 15:55:08.489336 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2536): Process ended prematurely: osmo-stp_10.42.42.5(pid=2536) [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2536)] [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 15:55:08.498919 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 15:55:08.526243 run osmo-hlr_10.42.42.2(pid=2533): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2533)] 15:55:08.573921 run osmo-hlr_10.42.42.2(pid=2533): stdout: | (launched: 2022-12-13_15:55:05.220671) 15:55:08.623370 run osmo-hlr_10.42.42.2(pid=2533): stderr: | [0;m[1;31m20221213155505400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155505400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155505400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155505400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155505400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155505400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155505412 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155505420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155505421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155505421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:08.673409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2523): Terminating (SIGTERM) 15:55:08.713921 run iperf3-srv_10.42.42.10(pid=2524): Terminating (SIGTERM) 15:55:08.754410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2528): Terminating (SIGTERM) 15:55:08.794305 run iperf3-srv_10.42.42.10(pid=2529): Terminating (SIGTERM) 15:55:08.833991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2532): Terminating (SIGTERM) 15:55:08.873641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2535): Terminating (SIGTERM) 15:55:08.913391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2538): Terminating (SIGTERM) 15:55:08.953516 --- ParallelTerminationStrategy: PID 2523 died... 15:55:08.972566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2523): Terminated: ok {rc=0} 15:55:09.016468 --- ParallelTerminationStrategy: PID 2524 died... 15:55:09.035092 run iperf3-srv_10.42.42.10(pid=2524): Terminated {rc=256} 15:55:09.078575 --- ParallelTerminationStrategy: PID 2528 died... 15:55:09.097117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2528): Terminated: ok {rc=0} 15:55:09.140683 --- ParallelTerminationStrategy: PID 2529 died... 15:55:09.159154 run iperf3-srv_10.42.42.10(pid=2529): Terminated {rc=256} 15:55:09.202632 --- ParallelTerminationStrategy: PID 2532 died... 15:55:09.221208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2532): Terminated: ok {rc=0} 15:55:09.264701 --- ParallelTerminationStrategy: PID 2535 died... 15:55:09.283352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2535): Terminated: ok {rc=0} 15:55:09.326829 --- ParallelTerminationStrategy: PID 2538 died... 15:55:09.345415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2538): Terminated: ok {rc=0} 15:55:09.431409 bus /gobi_0: Setting Powered False 15:55:10.530811 bus /gobi_0: Setting Powered False 15:55:11.647069 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 15:55:12.792392 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:12.804336 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:55:12.864805 tst iperf3.py: using LAC 34664 15:55:12.991273 tst iperf3.py: using RAC 239 15:55:13.113383 tst iperf3.py: using CellId 34664 15:55:13.233384 tst iperf3.py: using BVCI 34665 15:55:13.346078 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:13.357217 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:13.368004 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:13.378765 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:13.389435 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:13.400035 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:13.410970 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:13.421613 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:13.433218 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:55:13.548766 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:55:13.758436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:55:14.073385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2540): Launched 15:55:14.347599 run iperf3-srv_10.42.42.10(pid=2541): Launched 15:55:14.465766 tst iperf3.py:8: start network... 15:55:14.675639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:15.163811 run create_hlr_db(pid=2542): Launched 15:55:15.293197 bus /gobi_6: Setting Powered False 15:55:16.369714 run create_hlr_db(pid=2542): Terminated: ok {rc=0} 15:55:16.964563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2544): Launched 15:55:17.366240 run osmo-hlr_10.42.42.2(pid=2545): Launched 15:55:17.488890 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:18.046796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2547): Launched 15:55:18.363712 run osmo-stp_10.42.42.5(pid=2548): Launched 15:55:18.485505 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:55:19.027322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2550): Launched 15:55:19.149411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:55:19.415540 run patchelf(pid=2551): Launched 15:55:19.591670 run osmo-stp_10.42.42.5(pid=2548): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2548)] 15:55:19.724131 run osmo-stp_10.42.42.5(pid=2548): stdout: | (launched: 2022-12-13_15:55:18.304871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:19.858569 run osmo-stp_10.42.42.5(pid=2548): stderr: | [0;m[38;5;43m20221213155518481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155518481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155518481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155518482 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:19.993292 run osmo-stp_10.42.42.5(pid=2548): stdout: | (launched: 2022-12-13_15:55:18.304871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:20.121306 run osmo-stp_10.42.42.5(pid=2548): stderr: | [0;m[38;5;43m20221213155518481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155518481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155518481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155518482 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:20.273131 run patchelf(pid=2551): Terminating (SIGINT) 15:55:20.449860 run patchelf(pid=2551): Terminated: ok {rc=0} 15:55:20.577677 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2548): Process ended prematurely: osmo-stp_10.42.42.5(pid=2548) [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2548)] [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 15:55:20.587237 tst iperf3.py:8: Test FAILED (7.8 sec) 15:55:20.614432 run osmo-hlr_10.42.42.2(pid=2545): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2545)] 15:55:20.662090 run osmo-hlr_10.42.42.2(pid=2545): stdout: | (launched: 2022-12-13_15:55:17.307189) 15:55:20.711503 run osmo-hlr_10.42.42.2(pid=2545): stderr: | [0;m[1;31m20221213155517490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155517490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155517490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155517490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155517490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155517490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155517503 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155517511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155517512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155517512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:20.761532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2540): Terminating (SIGTERM) 15:55:20.801212 run iperf3-srv_10.42.42.10(pid=2541): Terminating (SIGTERM) 15:55:20.840931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2544): Terminating (SIGTERM) 15:55:20.881422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2547): Terminating (SIGTERM) 15:55:20.920876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2550): Terminating (SIGTERM) 15:55:20.960820 --- ParallelTerminationStrategy: PID 2540 died... 15:55:20.979885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2540): Terminated: ok {rc=0} 15:55:21.024147 --- ParallelTerminationStrategy: PID 2541 died... 15:55:21.042939 run iperf3-srv_10.42.42.10(pid=2541): Terminated {rc=256} 15:55:21.086950 --- ParallelTerminationStrategy: PID 2544 died... 15:55:21.105596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2544): Terminated: ok {rc=0} 15:55:21.149038 --- ParallelTerminationStrategy: PID 2547 died... 15:55:21.167492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2547): Terminated: ok {rc=0} 15:55:21.211511 --- ParallelTerminationStrategy: PID 2550 died... 15:55:21.229984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2550): Terminated: ok {rc=0} 15:55:21.316681 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 15:55:22.465570 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:22.477495 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:55:22.536583 tst iperf3m4.py: using LAC 34665 15:55:22.659991 tst iperf3m4.py: using RAC 240 15:55:22.784392 tst iperf3m4.py: using CellId 34665 15:55:22.909088 tst iperf3m4.py: using BVCI 34666 15:55:23.023802 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:23.034899 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:23.045682 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:23.056421 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:23.067111 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:23.077807 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:23.089251 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:23.103739 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:23.115475 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:55:23.236005 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:55:23.360291 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:55:23.479870 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:55:23.598324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:55:23.807793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:55:24.123879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2554): Launched 15:55:24.400374 run iperf3-srv_10.42.42.10(pid=2555): Launched 15:55:24.518627 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:55:24.727708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:55:25.043887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2556): Launched 15:55:25.320054 run iperf3-srv_10.42.42.10(pid=2557): Launched 15:55:25.439976 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:55:25.649171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:55:25.964596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2558): Launched 15:55:26.240867 run iperf3-srv_10.42.42.10(pid=2559): Launched 15:55:26.360768 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:55:26.569706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:55:26.884394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2560): Launched 15:55:27.162708 run iperf3-srv_10.42.42.10(pid=2561): Launched 15:55:27.282224 tst iperf3m4.py:8: start network... 15:55:27.491045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:27.976476 run create_hlr_db(pid=2562): Launched 15:55:28.104694 bus /gobi_6: Setting Powered False 15:55:29.166720 run create_hlr_db(pid=2562): Terminated: ok {rc=0} 15:55:29.603516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2564): Launched 15:55:29.918828 run osmo-hlr_10.42.42.2(pid=2565): Launched 15:55:30.040731 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:30.581453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2567): Launched 15:55:30.905728 run osmo-stp_10.42.42.5(pid=2568): Launched 15:55:31.194120 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:55:31.768493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2570): Launched 15:55:31.909263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:55:32.183978 run patchelf(pid=2571): Launched 15:55:32.386452 run osmo-stp_10.42.42.5(pid=2568): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2568)] 15:55:32.528281 run osmo-stp_10.42.42.5(pid=2568): stdout: | (launched: 2022-12-13_15:55:30.838355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:32.672358 run osmo-stp_10.42.42.5(pid=2568): stderr: | [0;m[38;5;43m20221213155531058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155531058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155531059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155531059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155531060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155531060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155531060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:32.816235 run osmo-stp_10.42.42.5(pid=2568): stdout: | (launched: 2022-12-13_15:55:30.838355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:32.953520 run osmo-stp_10.42.42.5(pid=2568): stderr: | [0;m[38;5;43m20221213155531058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155531058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155531059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155531059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155531060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155531060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155531060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:33.116453 run patchelf(pid=2571): Terminating (SIGINT) 15:55:33.305218 run patchelf(pid=2571): Terminated: ok {rc=0} 15:55:33.441186 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2568): Process ended prematurely: osmo-stp_10.42.42.5(pid=2568) [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2568)] [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 15:55:33.451649 tst iperf3m4.py:8: Test FAILED (11.0 sec) 15:55:33.481086 run osmo-hlr_10.42.42.2(pid=2565): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2565)] 15:55:33.532754 run osmo-hlr_10.42.42.2(pid=2565): stdout: | (launched: 2022-12-13_15:55:29.860065) 15:55:33.585594 run osmo-hlr_10.42.42.2(pid=2565): stderr: | [0;m[1;31m20221213155530036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155530036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155530036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155530036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155530036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155530037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155530049 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155530057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155530057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155530057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:33.638756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2554): Terminating (SIGTERM) 15:55:33.681962 run iperf3-srv_10.42.42.10(pid=2555): Terminating (SIGTERM) 15:55:33.725083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2556): Terminating (SIGTERM) 15:55:33.768407 run iperf3-srv_10.42.42.10(pid=2557): Terminating (SIGTERM) 15:55:33.811719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2558): Terminating (SIGTERM) 15:55:33.854987 run iperf3-srv_10.42.42.10(pid=2559): Terminating (SIGTERM) 15:55:33.898160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2560): Terminating (SIGTERM) 15:55:33.941400 run iperf3-srv_10.42.42.10(pid=2561): Terminating (SIGTERM) 15:55:33.984453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2564): Terminating (SIGTERM) 15:55:34.027687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2567): Terminating (SIGTERM) 15:55:34.070842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2570): Terminating (SIGTERM) 15:55:34.114131 --- ParallelTerminationStrategy: PID 2554 died... 15:55:34.134856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2554): Terminated: ok {rc=0} 15:55:34.182673 --- ParallelTerminationStrategy: PID 2555 died... 15:55:34.202839 run iperf3-srv_10.42.42.10(pid=2555): Terminated {rc=256} 15:55:34.250116 --- ParallelTerminationStrategy: PID 2556 died... 15:55:34.270319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2556): Terminated: ok {rc=0} 15:55:34.317762 --- ParallelTerminationStrategy: PID 2557 died... 15:55:34.337920 run iperf3-srv_10.42.42.10(pid=2557): Terminated {rc=256} 15:55:34.385125 --- ParallelTerminationStrategy: PID 2558 died... 15:55:34.405325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2558): Terminated: ok {rc=0} 15:55:34.452782 --- ParallelTerminationStrategy: PID 2559 died... 15:55:34.473119 run iperf3-srv_10.42.42.10(pid=2559): Terminated {rc=256} 15:55:34.520083 --- ParallelTerminationStrategy: PID 2560 died... 15:55:34.540196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2560): Terminated: ok {rc=0} 15:55:34.587707 --- ParallelTerminationStrategy: PID 2561 died... 15:55:34.608024 run iperf3-srv_10.42.42.10(pid=2561): Terminated {rc=256} 15:55:34.654943 --- ParallelTerminationStrategy: PID 2564 died... 15:55:34.675119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2564): Terminated: ok {rc=0} 15:55:34.722248 --- ParallelTerminationStrategy: PID 2567 died... 15:55:34.742563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2567): Terminated: ok {rc=0} 15:55:34.790170 --- ParallelTerminationStrategy: PID 2570 died... 15:55:34.810583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2570): Terminated: ok {rc=0} 15:55:34.901200 bus /gobi_4: Setting Powered False 15:55:36.001722 bus /gobi_4: Setting Powered False 15:55:37.119955 bus /gobi_1: Setting Powered False 15:55:38.217968 bus /gobi_1: Setting Powered False 15:55:39.338106 bus /gobi_0: Setting Powered False 15:55:40.437164 bus /gobi_0: Setting Powered False 15:55:41.554219 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 15:55:42.658027 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:42.669864 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:55:42.727784 tst ping.py: using LAC 34666 15:55:42.850061 tst ping.py: using RAC 241 15:55:42.970378 tst ping.py: using CellId 34666 15:55:43.092506 tst ping.py: using BVCI 34667 15:55:43.215380 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:43.227166 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:43.238499 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:43.250040 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:43.262200 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:43.274403 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:43.286677 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:43.298926 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:55:43.418148 tst ping.py:19: start network... 15:55:43.624652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:44.100611 run create_hlr_db(pid=2572): Launched 15:55:44.227205 bus /gobi_6: Setting Powered False 15:55:45.288185 run create_hlr_db(pid=2572): Terminated: ok {rc=0} 15:55:45.740074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2574): Launched 15:55:46.101724 run osmo-hlr_10.42.42.2(pid=2575): Launched 15:55:46.331408 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:46.975766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2577): Launched 15:55:47.322664 run osmo-stp_10.42.42.5(pid=2578): Launched 15:55:47.445294 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:55:47.978585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2580): Launched 15:55:48.097797 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:55:48.359296 run patchelf(pid=2581): Launched 15:55:48.532316 run osmo-stp_10.42.42.5(pid=2578): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2578)] 15:55:48.662582 run osmo-stp_10.42.42.5(pid=2578): stdout: | (launched: 2022-12-13_15:55:47.260672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:48.794965 run osmo-stp_10.42.42.5(pid=2578): stderr: | [0;m[38;5;43m20221213155547435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155547435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155547436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155547436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155547436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155547437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155547437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:48.927200 run osmo-stp_10.42.42.5(pid=2578): stdout: | (launched: 2022-12-13_15:55:47.260672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:49.052598 run osmo-stp_10.42.42.5(pid=2578): stderr: | [0;m[38;5;43m20221213155547435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155547435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155547436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155547436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155547436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155547437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155547437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:49.202561 run patchelf(pid=2581): Terminating (SIGINT) 15:55:49.374676 run patchelf(pid=2581): Terminated: ok {rc=0} 15:55:49.498781 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2578): Process ended prematurely: osmo-stp_10.42.42.5(pid=2578) [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2578)] [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 15:55:49.507811 tst ping.py:22: Test FAILED (6.8 sec) 15:55:49.534960 run osmo-hlr_10.42.42.2(pid=2575): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2575)] 15:55:49.583557 run osmo-hlr_10.42.42.2(pid=2575): stdout: | (launched: 2022-12-13_15:55:46.034944) 15:55:49.633810 run osmo-hlr_10.42.42.2(pid=2575): stderr: | [0;m[1;31m20221213155546340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155546340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155546340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155546340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155546340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155546340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155546383 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155546396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155546396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155546396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:49.684939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2574): Terminating (SIGTERM) 15:55:49.725735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2577): Terminating (SIGTERM) 15:55:49.766503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2580): Terminating (SIGTERM) 15:55:49.807380 --- ParallelTerminationStrategy: PID 2574 died... 15:55:49.826857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2574): Terminated: ok {rc=0} 15:55:49.871666 --- ParallelTerminationStrategy: PID 2577 died... 15:55:49.890589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2577): Terminated: ok {rc=0} 15:55:49.935161 --- ParallelTerminationStrategy: PID 2580 died... 15:55:49.954221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2580): Terminated: ok {rc=0} 15:55:50.039979 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 15:55:51.127700 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:51.140574 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:55:51.202580 tst ping_idle_ping.py: using LAC 34667 15:55:51.335630 tst ping_idle_ping.py: using RAC 242 15:55:51.466443 tst ping_idle_ping.py: using CellId 34667 15:55:51.596250 tst ping_idle_ping.py: using BVCI 34668 15:55:51.716274 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:51.727969 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:51.739299 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:51.750667 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:51.762203 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:51.773872 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:51.785614 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:55:51.797175 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:55:51.922863 tst ping_idle_ping.py:24: start network... 15:55:52.149097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:52.669141 run create_hlr_db(pid=2585): Launched 15:55:52.797176 bus /gobi_6: Setting Powered False 15:55:53.862259 run create_hlr_db(pid=2585): Terminated: ok {rc=0} 15:55:54.323549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2587): Launched 15:55:54.655090 run osmo-hlr_10.42.42.2(pid=2588): Launched 15:55:54.781726 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:55.350917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2590): Launched 15:55:55.684716 run osmo-stp_10.42.42.5(pid=2591): Launched 15:55:55.812733 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:55:56.382369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2593): Launched 15:55:56.508309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:55:56.786863 run patchelf(pid=2594): Launched 15:55:56.969294 run osmo-stp_10.42.42.5(pid=2591): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2591)] 15:55:57.107930 run osmo-stp_10.42.42.5(pid=2591): stdout: | (launched: 2022-12-13_15:55:55.623282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:57.249429 run osmo-stp_10.42.42.5(pid=2591): stderr: | [0;m[38;5;43m20221213155555818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155555818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155555818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155555819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155555819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155555819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155555819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:57.390154 run osmo-stp_10.42.42.5(pid=2591): stdout: | (launched: 2022-12-13_15:55:55.623282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:57.524158 run osmo-stp_10.42.42.5(pid=2591): stderr: | [0;m[38;5;43m20221213155555818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155555818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155555818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155555819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155555819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155555819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155555819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:57.683429 run patchelf(pid=2594): Terminating (SIGINT) 15:55:57.867605 run patchelf(pid=2594): Terminated: ok {rc=0} 15:55:58.000348 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2591): Process ended prematurely: osmo-stp_10.42.42.5(pid=2591) [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2591)] [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 15:55:58.010167 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 15:55:58.038351 run osmo-hlr_10.42.42.2(pid=2588): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2588)] 15:55:58.089424 run osmo-hlr_10.42.42.2(pid=2588): stdout: | (launched: 2022-12-13_15:55:54.593364) 15:55:58.142034 run osmo-hlr_10.42.42.2(pid=2588): stderr: | [0;m[1;31m20221213155554796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155554797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155554797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155554797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155554797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155554797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155554833 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155554842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155554842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155554842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:58.195105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2587): Terminating (SIGTERM) 15:55:58.237531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2590): Terminating (SIGTERM) 15:55:58.280412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2593): Terminating (SIGTERM) 15:55:58.323213 --- ParallelTerminationStrategy: PID 2587 died... 15:55:58.343502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2587): Terminated: ok {rc=0} 15:55:58.390126 --- ParallelTerminationStrategy: PID 2590 died... 15:55:58.409998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2590): Terminated: ok {rc=0} 15:55:58.456477 --- ParallelTerminationStrategy: PID 2593 died... 15:55:58.476589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2593): Terminated: ok {rc=0} 15:55:58.565070 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:55:59.858126 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:59.864768 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:55:59.885400 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 15:55:59.920836 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:55:59.974224 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:55:59.995818 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 15:56:00.031999 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:56:00.593140 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 15:56:00.598945 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:56:00.610761 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:56:00.668318 tst switch_tch_pdch.py: using LAC 34668 15:56:00.794598 tst switch_tch_pdch.py: using RAC 243 15:56:00.934425 tst switch_tch_pdch.py: using CellId 34668 15:56:01.065246 tst switch_tch_pdch.py: using BVCI 34669 15:56:01.187880 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:56:01.200744 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:56:01.213619 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:56:01.226315 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:56:01.240142 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:56:01.254070 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:56:01.267863 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:56:01.281433 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:56:01.409782 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:56:01.548432 tst switch_tch_pdch.py:51: start network... 15:56:01.789324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:02.310228 run create_hlr_db(pid=2598): Launched 15:56:02.441897 bus /gobi_6: Setting Powered False 15:56:03.503435 run create_hlr_db(pid=2598): Terminated: ok {rc=0} 15:56:03.954744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2600): Launched 15:56:04.285702 run osmo-hlr_10.42.42.2(pid=2601): Launched 15:56:04.412391 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:04.979575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2603): Launched 15:56:05.311356 run osmo-stp_10.42.42.5(pid=2604): Launched 15:56:05.438230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:56:06.005733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2606): Launched 15:56:06.132259 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:56:06.411451 run patchelf(pid=2607): Launched 15:56:06.595798 run osmo-stp_10.42.42.5(pid=2604): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2604)] 15:56:06.734852 run osmo-stp_10.42.42.5(pid=2604): stdout: | (launched: 2022-12-13_15:56:05.250476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:06.876114 run osmo-stp_10.42.42.5(pid=2604): stderr: | [0;m[38;5;43m20221213155605444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155605444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155605444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155605445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155605445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155605445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155605445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:07.016704 run osmo-stp_10.42.42.5(pid=2604): stdout: | (launched: 2022-12-13_15:56:05.250476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:07.150752 run osmo-stp_10.42.42.5(pid=2604): stderr: | [0;m[38;5;43m20221213155605444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155605444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155605444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155605445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155605445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155605445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155605445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:07.310579 run patchelf(pid=2607): Terminating (SIGINT) 15:56:07.494617 run patchelf(pid=2607): Terminated: ok {rc=0} 15:56:07.627398 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2604): Process ended prematurely: osmo-stp_10.42.42.5(pid=2604) [trial-2391↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2604)] [trial-2391↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 15:56:07.637202 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 15:56:07.665443 run osmo-hlr_10.42.42.2(pid=2601): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2601)] 15:56:07.716418 run osmo-hlr_10.42.42.2(pid=2601): stdout: | (launched: 2022-12-13_15:56:04.224332) 15:56:07.769296 run osmo-hlr_10.42.42.2(pid=2601): stderr: | [0;m[1;31m20221213155604428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155604428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155604428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155604428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155604428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155604428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155604441 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155604450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155604450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155604450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:07.821850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2600): Terminating (SIGTERM) 15:56:07.864146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2603): Terminating (SIGTERM) 15:56:07.906457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2606): Terminating (SIGTERM) 15:56:07.949351 --- ParallelTerminationStrategy: PID 2600 died... 15:56:07.969862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2600): Terminated: ok {rc=0} 15:56:08.016539 --- ParallelTerminationStrategy: PID 2603 died... 15:56:08.036495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2603): Terminated: ok {rc=0} 15:56:08.082825 --- ParallelTerminationStrategy: PID 2606 died... 15:56:08.102683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2606): Terminated: ok {rc=0} 15:56:08.191498 bus /gobi_0: Setting Powered False 15:56:09.290866 bus /gobi_0: Setting Powered False 15:56:10.406546 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 15:56:11.640758 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:56:11.646718 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 15:56:11.667682 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 15:56:11.702412 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 15:56:11.756483 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 15:56:11.777582 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 15:56:11.812488 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 15:56:12.370771 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 15:56:12.376439 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:56:12.388222 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 15:56:12.447677 tst switch_tch_pdch.py: using LAC 34669 15:56:12.577208 tst switch_tch_pdch.py: using RAC 244 15:56:12.709411 tst switch_tch_pdch.py: using CellId 34669 15:56:12.836748 tst switch_tch_pdch.py: using BVCI 34670 15:56:12.955915 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:56:12.967448 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:56:12.978821 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:56:12.990244 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:56:13.001927 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:56:13.013581 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:56:13.025322 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:56:13.037161 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:56:13.154246 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:56:13.275432 tst switch_tch_pdch.py:51: start network... 15:56:13.497344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:13.977630 run create_hlr_db(pid=2611): Launched 15:56:14.104016 bus /gobi_6: Setting Powered False 15:56:15.168261 run create_hlr_db(pid=2611): Terminated: ok {rc=0} 15:56:15.584418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2613): Launched 15:56:15.921548 run osmo-hlr_10.42.42.2(pid=2614): Launched 15:56:16.192570 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:16.760629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2616): Launched 15:56:17.105086 run osmo-stp_10.42.42.5(pid=2617): Launched 15:56:17.364357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:56:17.866520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2620): Launched 15:56:17.985542 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:56:18.246426 run patchelf(pid=2622): Launched 15:56:18.419007 run osmo-stp_10.42.42.5(pid=2617): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2617)] 15:56:18.548814 run osmo-stp_10.42.42.5(pid=2617): stdout: | (launched: 2022-12-13_15:56:17.043638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:18.680816 run osmo-stp_10.42.42.5(pid=2617): stderr: | [0;m[38;5;43m20221213155617280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155617280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155617281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155617281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155617283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155617283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155617283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:18.812579 run osmo-stp_10.42.42.5(pid=2617): stdout: | (launched: 2022-12-13_15:56:17.043638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:18.938218 run osmo-stp_10.42.42.5(pid=2617): stderr: | [0;m[38;5;43m20221213155617280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155617280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155617281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155617281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155617283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155617283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155617283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:19.086779 run patchelf(pid=2622): Terminating (SIGINT) 15:56:19.258712 run patchelf(pid=2622): Terminated: ok {rc=0} 15:56:19.383416 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2617): Process ended prematurely: osmo-stp_10.42.42.5(pid=2617) [trial-2391↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2617)] [trial-2391↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 15:56:19.392436 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 15:56:19.419376 run osmo-hlr_10.42.42.2(pid=2614): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2614)] 15:56:19.467582 run osmo-hlr_10.42.42.2(pid=2614): stdout: | (launched: 2022-12-13_15:56:15.847293) 15:56:19.517427 run osmo-hlr_10.42.42.2(pid=2614): stderr: | [0;m[1;31m20221213155616064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155616064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155616064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155616064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155616064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155616064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155616080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155616096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155616096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155616096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:19.567804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2613): Terminating (SIGTERM) 15:56:19.608392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2616): Terminating (SIGTERM) 15:56:19.649123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2620): Terminating (SIGTERM) 15:56:19.690009 --- ParallelTerminationStrategy: PID 2613 died... 15:56:19.709613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2613): Terminated: ok {rc=0} 15:56:19.754166 --- ParallelTerminationStrategy: PID 2616 died... 15:56:19.772914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2616): Terminated: ok {rc=0} 15:56:19.817329 --- ParallelTerminationStrategy: PID 2620 died... 15:56:19.836088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2620): Terminated: ok {rc=0} 15:56:19.920357 bus /gobi_0: Setting Powered False 15:56:21.020125 bus /gobi_0: Setting Powered False 15:56:22.138436 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_sms:trx-b200 --------------------------------------------------------------------- 15:56:23.383285 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:56:23.387604 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 15:56:23.420641 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 15:56:23.428358 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 15:56:23.479087 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 15:56:23.512200 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 15:56:23.518904 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 15:56:24.061924 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 15:56:24.068512 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 15:56:24.080816 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 15:56:24.132584 tst mo_mt_sms.py: using LAC 34670 15:56:24.260642 tst mo_mt_sms.py: using RAC 245 15:56:24.387301 tst mo_mt_sms.py: using CellId 34670 15:56:24.515846 tst mo_mt_sms.py: using BVCI 34671 15:56:24.635441 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 15:56:24.752234 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 15:56:24.867470 tst mo_mt_sms.py:9: start nitb and bts... 15:56:25.074690 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:56:25.703105 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2627): Launched 15:56:26.013199 run osmo-nitb_10.42.42.2(pid=2628): Launched 15:56:26.183890 run osmo-nitb_10.42.42.2(pid=2628): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2628)] 15:56:26.321924 run osmo-nitb_10.42.42.2(pid=2628): stdout: | (launched: 2022-12-13_15:56:25.955335) 15:56:26.461317 run osmo-nitb_10.42.42.2(pid=2628): stderr: | (launched: 2022-12-13_15:56:26.001206) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:56:26.600705 run osmo-nitb_10.42.42.2(pid=2628): stdout: | (launched: 2022-12-13_15:56:25.955335) 15:56:26.733870 run osmo-nitb_10.42.42.2(pid=2628): stderr: | (launched: 2022-12-13_15:56:26.001206) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2628): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2628) [trial-2391↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2628)] 15:56:27.130153 tst osmo-nitb_10.42.42.2(pid=2628): stdout: | (launched: 2022-12-13_15:56:25.955335) 15:56:27.254289 tst osmo-nitb_10.42.42.2(pid=2628): stderr: | (launched: 2022-12-13_15:56:26.001206) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:56:27.400748 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=2628): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2628) [trial-2391↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2628)] [trial-2391↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 15:56:27.409511 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 15:56:27.416306 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2627): Terminating (SIGTERM) 15:56:27.625393 --- ParallelTerminationStrategy: PID 2627 died... 15:56:27.646057 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2627): Terminated: ok {rc=0} 15:56:27.732234 bus /sierra_3: Setting Powered False 15:56:28.829711 bus /sierra_3: Setting Powered False 15:56:29.945580 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 sms:trx-b200 --------------------------------------------------------------------- 15:56:31.147871 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:56:31.155855 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 15:56:31.209399 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 15:56:31.245404 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 15:56:31.301981 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 15:56:31.347640 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 15:56:31.380199 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 15:56:31.908326 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 15:56:31.916405 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:31.929812 tst sms:trx-b200: Using 1 x bts (candidates: 1) 15:56:31.996520 tst mo_mt_sms.py: using LAC 34671 15:56:32.125587 tst mo_mt_sms.py: using RAC 246 15:56:32.255921 tst mo_mt_sms.py: using CellId 34671 15:56:32.384282 tst mo_mt_sms.py: using BVCI 34672 15:56:32.503286 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:32.514494 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:32.525762 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:32.536622 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:32.548039 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:32.559576 tst sms:trx-b200: Using 1 x modem (candidates: 2) 15:56:32.681962 tst sms:trx-b200: Using 1 x modem (candidates: 2) 15:56:32.800054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:33.277808 run create_hlr_db(pid=2632): Launched 15:56:33.405117 bus /sierra_2: Setting Powered False 15:56:34.465679 run create_hlr_db(pid=2632): Terminated: ok {rc=0} 15:56:34.915827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2634): Launched 15:56:35.249206 run osmo-hlr_10.42.42.2(pid=2635): Launched 15:56:35.377904 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:35.944935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2637): Launched 15:56:36.259481 run osmo-stp_10.42.42.5(pid=2638): Launched 15:56:36.379059 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:36.937994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2640): Launched 15:56:37.247618 run osmo-msc_10.42.42.6(pid=2641): Launched 15:56:37.421248 run osmo-stp_10.42.42.5(pid=2638): ERR: Terminated: ERROR {rc=1} [trial-2391↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2638)] 15:56:37.551972 run osmo-stp_10.42.42.5(pid=2638): stdout: | (launched: 2022-12-13_15:56:36.202122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:37.682444 run osmo-stp_10.42.42.5(pid=2638): stderr: | [0;m[38;5;43m20221213155636374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155636374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155636374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155636374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155636377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155636377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155636377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:37.811308 run osmo-stp_10.42.42.5(pid=2638): stdout: | (launched: 2022-12-13_15:56:36.202122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:37.933840 run osmo-stp_10.42.42.5(pid=2638): stderr: | [0;m[38;5;43m20221213155636374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155636374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155636374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155636374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155636377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155636377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155636377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:38.079840 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=2638): Process ended prematurely: osmo-stp_10.42.42.5(pid=2638) [trial-2391↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2638)] [trial-2391↪sms:trx-b200↪mo_mt_sms.py:16] 15:56:38.088522 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 15:56:38.114903 run osmo-hlr_10.42.42.2(pid=2635): ERR: Terminated: ERROR {rc=237} [trial-2391↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2635)] 15:56:38.163249 run osmo-hlr_10.42.42.2(pid=2635): stdout: | (launched: 2022-12-13_15:56:35.187384) 15:56:38.213076 run osmo-hlr_10.42.42.2(pid=2635): stderr: | [0;m[1;31m20221213155635389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155635389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155635389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155635389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155635389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155635389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155635401 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155635412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155635412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155635412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:38.282422 run osmo-msc_10.42.42.6(pid=2641): ERR: Terminated: ERROR {rc=2} [trial-2391↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2641)] 15:56:38.330315 run osmo-msc_10.42.42.6(pid=2641): stdout: | (launched: 2022-12-13_15:56:37.189663) 15:56:38.379832 run osmo-msc_10.42.42.6(pid=2641): stderr: | [0;m[38;5;43m20221213155637466 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155637466 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdac0bcec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155637466 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155637466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155637466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155637466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155637468 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155637468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155637468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155637469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:38.429975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2634): Terminating (SIGTERM) 15:56:38.469807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2637): Terminating (SIGTERM) 15:56:38.509729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2640): Terminating (SIGTERM) 15:56:38.549956 --- ParallelTerminationStrategy: PID 2634 died... 15:56:38.569397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2634): Terminated: ok {rc=0} 15:56:38.613917 --- ParallelTerminationStrategy: PID 2637 died... 15:56:38.632920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2637): Terminated: ok {rc=0} 15:56:38.677537 --- ParallelTerminationStrategy: PID 2640 died... 15:56:38.696451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2640): Terminated: ok {rc=0} 15:56:38.783585 bus /sierra_3: Setting Powered False 15:56:39.884376 bus /sierra_3: Setting Powered False 15:56:41.000684 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_ussd:trx-b200 --------------------------------------------------------------------- 15:56:42.240198 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:56:42.245138 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 15:56:42.278253 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 15:56:42.285415 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 15:56:42.321623 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 15:56:42.355165 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 15:56:42.361924 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 15:56:42.881143 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2391 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 15:56:42.886045 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 15:56:42.896786 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 15:56:42.945406 tst assert_extension.py: using LAC 34672 15:56:43.067591 tst assert_extension.py: using RAC 247 15:56:43.189308 tst assert_extension.py: using CellId 34672 15:56:43.310330 tst assert_extension.py: using BVCI 34673 15:56:43.422572 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 15:56:43.544820 tst assert_extension.py:10: start nitb and bts... 15:56:43.767015 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:56:44.441238 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2646): Launched 15:56:44.772156 run osmo-nitb_10.42.42.2(pid=2647): Launched 15:56:44.954954 run osmo-nitb_10.42.42.2(pid=2647): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2647)] 15:56:45.102445 run osmo-nitb_10.42.42.2(pid=2647): stdout: | (launched: 2022-12-13_15:56:44.711058) 15:56:45.251496 run osmo-nitb_10.42.42.2(pid=2647): stderr: | (launched: 2022-12-13_15:56:44.760053) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:56:45.400103 run osmo-nitb_10.42.42.2(pid=2647): stdout: | (launched: 2022-12-13_15:56:44.711058) 15:56:45.543042 run osmo-nitb_10.42.42.2(pid=2647): stderr: | (launched: 2022-12-13_15:56:44.760053) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2647): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2647) [trial-2391↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2647)] 15:56:45.897303 tst osmo-nitb_10.42.42.2(pid=2647): stdout: | (launched: 2022-12-13_15:56:44.711058) 15:56:46.034553 tst osmo-nitb_10.42.42.2(pid=2647): stderr: | (launched: 2022-12-13_15:56:44.760053) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:56:46.195714 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=2647): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2647) [trial-2391↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2647)] [trial-2391↪nitb_ussd:trx-b200↪assert_extension.py:12] 15:56:46.206120 tst assert_extension.py:12: Test FAILED (3.3 sec) 15:56:46.214444 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2646): Terminating (SIGTERM) 15:56:46.429672 --- ParallelTerminationStrategy: PID 2646 died... 15:56:46.451267 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2646): Terminated: ok {rc=0} 15:56:46.547545 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 ussd:trx-b200 --------------------------------------------------------------------- 15:56:47.737154 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:56:47.741701 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 15:56:47.775394 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 15:56:47.803418 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 15:56:47.839113 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 15:56:47.872284 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 15:56:47.899015 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 15:56:48.427761 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2391 ussd:trx-b200 assert_extension.py ---------------------------------------------- 15:56:48.433121 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:48.443984 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 15:56:48.492086 tst assert_extension.py: using LAC 34673 15:56:48.613315 tst assert_extension.py: using RAC 248 15:56:48.734417 tst assert_extension.py: using CellId 34673 15:56:48.854718 tst assert_extension.py: using BVCI 34674 15:56:48.967312 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:48.978099 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:48.988669 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:48.999189 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:49.009677 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:56:49.020784 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 15:56:49.135546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:49.613439 run create_hlr_db(pid=2651): Launched 15:56:49.740311 bus /sierra_2: Setting Powered False 15:56:50.801533 run create_hlr_db(pid=2651): Terminated: ok {rc=0} 15:56:51.234821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2653): Launched 15:56:51.545151 run osmo-hlr_10.42.42.2(pid=2654): Launched 15:56:51.664565 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:52.198025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2656): Launched 15:56:52.508070 run osmo-stp_10.42.42.5(pid=2657): Launched 15:56:52.627588 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:53.183326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2659): Launched 15:56:53.493728 run osmo-msc_10.42.42.6(pid=2660): Launched 15:56:53.668395 run osmo-stp_10.42.42.5(pid=2657): ERR: Terminated: ERROR {rc=1} [trial-2391↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2657)] 15:56:53.798242 run osmo-stp_10.42.42.5(pid=2657): stdout: | (launched: 2022-12-13_15:56:52.450008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:53.927920 run osmo-stp_10.42.42.5(pid=2657): stderr: | [0;m[38;5;43m20221213155652622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155652622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155652623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155652623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155652624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155652624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155652624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:54.055291 run osmo-stp_10.42.42.5(pid=2657): stdout: | (launched: 2022-12-13_15:56:52.450008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:54.176712 run osmo-stp_10.42.42.5(pid=2657): stderr: | [0;m[38;5;43m20221213155652622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155652622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155652623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155652623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155652624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155652624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155652624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:54.322938 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=2657): Process ended prematurely: osmo-stp_10.42.42.5(pid=2657) [trial-2391↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2657)] [trial-2391↪ussd:trx-b200↪assert_extension.py:17] 15:56:54.331460 tst assert_extension.py:17: Test FAILED (5.9 sec) 15:56:54.357767 run osmo-hlr_10.42.42.2(pid=2654): ERR: Terminated: ERROR {rc=237} [trial-2391↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2654)] 15:56:54.406401 run osmo-hlr_10.42.42.2(pid=2654): stdout: | (launched: 2022-12-13_15:56:51.486985) 15:56:54.457095 run osmo-hlr_10.42.42.2(pid=2654): stderr: | [0;m[1;31m20221213155651665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155651665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155651665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155651665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155651665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155651665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155651678 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155651686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155651686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155651686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:54.538397 run osmo-msc_10.42.42.6(pid=2660): ERR: Terminated: ERROR {rc=2} [trial-2391↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2660)] 15:56:54.586797 run osmo-msc_10.42.42.6(pid=2660): stdout: | (launched: 2022-12-13_15:56:53.435693) 15:56:54.636577 run osmo-msc_10.42.42.6(pid=2660): stderr: | [0;m[38;5;43m20221213155653713 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155653713 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdf7cecbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155653714 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155653714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155653714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155653714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155653716 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155653716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155653716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155653716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:54.686871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2653): Terminating (SIGTERM) 15:56:54.727199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2656): Terminating (SIGTERM) 15:56:54.767436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2659): Terminating (SIGTERM) 15:56:54.808068 --- ParallelTerminationStrategy: PID 2653 died... 15:56:54.827721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2653): Terminated: ok {rc=0} 15:56:54.872187 --- ParallelTerminationStrategy: PID 2656 died... 15:56:54.891070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2656): Terminated: ok {rc=0} 15:56:54.935640 --- ParallelTerminationStrategy: PID 2659 died... 15:56:54.954594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2659): Terminated: ok {rc=0} 15:56:55.042951 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:56:56.262994 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:56:56.271511 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:56:56.307017 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:56:56.335219 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:56:56.388731 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:56:56.423333 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:56:56.451474 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:56:57.002643 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:56:57.057823 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:56:57.069745 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:56:57.142216 tst mo_mt_call.py: using LAC 34674 15:56:57.274790 tst mo_mt_call.py: using RAC 249 15:56:57.406790 tst mo_mt_call.py: using CellId 34674 15:56:57.539330 tst mo_mt_call.py: using BVCI 34675 15:56:57.661680 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:56:57.673734 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:56:57.685448 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:56:57.697127 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:56:57.709421 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:56:57.721659 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:56:57.841342 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:56:57.965287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:58.485020 run create_hlr_db(pid=2665): Launched 15:56:58.614747 bus /sierra_2: Setting Powered False 15:56:59.677569 run create_hlr_db(pid=2665): Terminated: ok {rc=0} 15:57:00.125669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2667): Launched 15:57:00.440924 run osmo-hlr_10.42.42.2(pid=2668): Launched 15:57:00.562502 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:01.162753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2670): Launched 15:57:01.519388 run osmo-stp_10.42.42.5(pid=2671): Launched 15:57:01.770521 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:02.447313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2673): Launched 15:57:02.786636 run osmo-msc_10.42.42.6(pid=2674): Launched 15:57:02.973666 run osmo-stp_10.42.42.5(pid=2671): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2671)] 15:57:03.114217 run osmo-stp_10.42.42.5(pid=2671): stdout: | (launched: 2022-12-13_15:57:01.456848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:03.290912 run osmo-stp_10.42.42.5(pid=2671): stderr: | [0;m[38;5;43m20221213155701756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155701756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155701756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155701765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155701767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155701768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155701768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:03.431810 run osmo-stp_10.42.42.5(pid=2671): stdout: | (launched: 2022-12-13_15:57:01.456848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:03.565730 run osmo-stp_10.42.42.5(pid=2671): stderr: | [0;m[38;5;43m20221213155701756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155701756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155701756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155701765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155701767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155701768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155701768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:03.725862 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2671): Process ended prematurely: osmo-stp_10.42.42.5(pid=2671) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2671)] [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:57:03.735830 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 15:57:03.764058 run osmo-hlr_10.42.42.2(pid=2668): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2668)] 15:57:03.816611 run osmo-hlr_10.42.42.2(pid=2668): stdout: | (launched: 2022-12-13_15:57:00.382259) 15:57:03.869835 run osmo-hlr_10.42.42.2(pid=2668): stderr: | [0;m[1;31m20221213155700563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155700563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155700563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155700563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155700563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155700563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155700575 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155700583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155700583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155700583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:03.943316 run osmo-msc_10.42.42.6(pid=2674): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2674)] 15:57:03.994254 run osmo-msc_10.42.42.6(pid=2674): stdout: | (launched: 2022-12-13_15:57:02.724317) 15:57:04.047643 run osmo-msc_10.42.42.6(pid=2674): stderr: | [0;m[38;5;43m20221213155703050 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155703050 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5a3c18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155703050 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155703050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155703050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155703050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155703052 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155703053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155703053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155703053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:04.101067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2667): Terminating (SIGTERM) 15:57:04.143403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2670): Terminating (SIGTERM) 15:57:04.186550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2673): Terminating (SIGTERM) 15:57:04.230315 --- ParallelTerminationStrategy: PID 2667 died... 15:57:04.251123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2667): Terminated: ok {rc=0} 15:57:04.298642 --- ParallelTerminationStrategy: PID 2670 died... 15:57:04.318841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2670): Terminated: ok {rc=0} 15:57:04.366494 --- ParallelTerminationStrategy: PID 2673 died... 15:57:04.387113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2673): Terminated: ok {rc=0} 15:57:04.477176 bus /sierra_3: Setting Powered False 15:57:05.576685 bus /sierra_3: Setting Powered False 15:57:06.694035 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:57:07.847293 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:57:07.859914 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:57:07.933382 tst mo_mt_call_osmux.py: using LAC 34675 15:57:08.064636 tst mo_mt_call_osmux.py: using RAC 250 15:57:08.195493 tst mo_mt_call_osmux.py: using CellId 34675 15:57:08.333291 tst mo_mt_call_osmux.py: using BVCI 34676 15:57:08.455963 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:57:08.467670 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:57:08.479164 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:57:08.490671 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:57:08.502642 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:57:08.514531 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:57:08.635164 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:57:08.758074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:09.246548 run create_hlr_db(pid=2676): Launched 15:57:09.377473 bus /sierra_2: Setting Powered False 15:57:10.439055 run create_hlr_db(pid=2676): Terminated: ok {rc=0} 15:57:10.877264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2678): Launched 15:57:11.192851 run osmo-hlr_10.42.42.2(pid=2679): Launched 15:57:11.312287 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:11.851667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2681): Launched 15:57:12.168641 run osmo-stp_10.42.42.5(pid=2682): Launched 15:57:12.289668 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:12.854153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2684): Launched 15:57:13.167982 run osmo-msc_10.42.42.6(pid=2685): Launched 15:57:13.344668 run osmo-stp_10.42.42.5(pid=2682): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2682)] 15:57:13.476334 run osmo-stp_10.42.42.5(pid=2682): stdout: | (launched: 2022-12-13_15:57:12.110028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:13.608071 run osmo-stp_10.42.42.5(pid=2682): stderr: | [0;m[38;5;43m20221213155712282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155712282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155712282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155712283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155712285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155712285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155712285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:13.738358 run osmo-stp_10.42.42.5(pid=2682): stdout: | (launched: 2022-12-13_15:57:12.110028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:13.862385 run osmo-stp_10.42.42.5(pid=2682): stderr: | [0;m[38;5;43m20221213155712282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155712282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155712282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155712283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155712285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155712285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155712285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:14.010795 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2682): Process ended prematurely: osmo-stp_10.42.42.5(pid=2682) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2682)] [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:57:14.020031 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:57:14.046823 run osmo-hlr_10.42.42.2(pid=2679): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2679)] 15:57:14.095313 run osmo-hlr_10.42.42.2(pid=2679): stdout: | (launched: 2022-12-13_15:57:11.134558) 15:57:14.145560 run osmo-hlr_10.42.42.2(pid=2679): stderr: | [0;m[1;31m20221213155711316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155711316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155711316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155711316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155711316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155711317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155711345 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155711355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155711355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155711355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:14.215040 run osmo-msc_10.42.42.6(pid=2685): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2685)] 15:57:14.262944 run osmo-msc_10.42.42.6(pid=2685): stdout: | (launched: 2022-12-13_15:57:13.109486) 15:57:14.312648 run osmo-msc_10.42.42.6(pid=2685): stderr: | [0;m[38;5;43m20221213155713386 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155713386 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ad011ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155713386 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155713387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155713387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155713387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155713389 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155713389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155713389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155713389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:14.362650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2678): Terminating (SIGTERM) 15:57:14.402743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2681): Terminating (SIGTERM) 15:57:14.442855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2684): Terminating (SIGTERM) 15:57:14.483219 --- ParallelTerminationStrategy: PID 2678 died... 15:57:14.502515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2678): Terminated: ok {rc=0} 15:57:14.546847 --- ParallelTerminationStrategy: PID 2681 died... 15:57:14.565735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2681): Terminated: ok {rc=0} 15:57:14.610061 --- ParallelTerminationStrategy: PID 2684 died... 15:57:14.628937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2684): Terminated: ok {rc=0} 15:57:14.715813 bus /sierra_3: Setting Powered False 15:57:15.815456 bus /sierra_3: Setting Powered False 15:57:16.942292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:57:18.198353 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:57:18.205651 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:57:18.241098 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:57:18.269264 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:57:18.323109 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:57:18.357985 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:57:18.385915 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:57:18.938421 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:57:18.992477 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:19.004284 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:57:19.076623 tst mo_mt_call.py: using LAC 34676 15:57:19.208686 tst mo_mt_call.py: using RAC 251 15:57:19.340730 tst mo_mt_call.py: using CellId 34676 15:57:19.472697 tst mo_mt_call.py: using BVCI 34677 15:57:19.594598 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:19.606301 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:19.617845 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:19.629383 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:19.641435 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:19.653333 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:57:19.772455 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:57:19.896358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:20.416548 run create_hlr_db(pid=2690): Launched 15:57:20.546561 bus /sierra_2: Setting Powered False 15:57:21.612335 run create_hlr_db(pid=2690): Terminated: ok {rc=0} 15:57:22.063537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2692): Launched 15:57:22.381966 run osmo-hlr_10.42.42.2(pid=2693): Launched 15:57:22.503730 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:23.045426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2695): Launched 15:57:23.362375 run osmo-stp_10.42.42.5(pid=2696): Launched 15:57:23.484121 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:24.054634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2698): Launched 15:57:24.372305 run osmo-msc_10.42.42.6(pid=2699): Launched 15:57:24.551047 run osmo-stp_10.42.42.5(pid=2696): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2696)] 15:57:24.683734 run osmo-stp_10.42.42.5(pid=2696): stdout: | (launched: 2022-12-13_15:57:23.303462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:24.816929 run osmo-stp_10.42.42.5(pid=2696): stderr: | [0;m[38;5;43m20221213155723477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155723477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155723477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155723477 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155723478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155723478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155723478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:24.947821 run osmo-stp_10.42.42.5(pid=2696): stdout: | (launched: 2022-12-13_15:57:23.303462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:25.073173 run osmo-stp_10.42.42.5(pid=2696): stderr: | [0;m[38;5;43m20221213155723477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155723477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155723477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155723477 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155723478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155723478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155723478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:25.222895 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2696): Process ended prematurely: osmo-stp_10.42.42.5(pid=2696) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2696)] [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:57:25.232167 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:57:25.259209 run osmo-hlr_10.42.42.2(pid=2693): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2693)] 15:57:25.307850 run osmo-hlr_10.42.42.2(pid=2693): stdout: | (launched: 2022-12-13_15:57:22.323168) 15:57:25.358061 run osmo-hlr_10.42.42.2(pid=2693): stderr: | [0;m[1;31m20221213155722505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155722505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155722505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155722505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155722505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155722505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155722517 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155722526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155722526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155722526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:25.427462 run osmo-msc_10.42.42.6(pid=2699): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2699)] 15:57:25.475479 run osmo-msc_10.42.42.6(pid=2699): stdout: | (launched: 2022-12-13_15:57:24.313405) 15:57:25.525257 run osmo-msc_10.42.42.6(pid=2699): stderr: | [0;m[38;5;43m20221213155724593 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155724593 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe50288c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155724593 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155724593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155724593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155724593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155724595 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155724595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155724596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155724596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:25.575604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2692): Terminating (SIGTERM) 15:57:25.615819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2695): Terminating (SIGTERM) 15:57:25.656290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2698): Terminating (SIGTERM) 15:57:25.696905 --- ParallelTerminationStrategy: PID 2692 died... 15:57:25.716551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2692): Terminated: ok {rc=0} 15:57:25.761377 --- ParallelTerminationStrategy: PID 2695 died... 15:57:25.780491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2695): Terminated: ok {rc=0} 15:57:25.825839 --- ParallelTerminationStrategy: PID 2698 died... 15:57:25.845411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2698): Terminated: ok {rc=0} 15:57:25.933698 bus /sierra_3: Setting Powered False 15:57:27.037460 bus /sierra_3: Setting Powered False 15:57:28.159804 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:57:29.308810 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:29.321057 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:57:29.392745 tst mo_mt_call_osmux.py: using LAC 34677 15:57:29.517307 tst mo_mt_call_osmux.py: using RAC 252 15:57:29.641428 tst mo_mt_call_osmux.py: using CellId 34677 15:57:29.765630 tst mo_mt_call_osmux.py: using BVCI 34678 15:57:29.889071 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:29.900913 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:29.913128 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:29.924761 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:29.937321 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:57:29.949662 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:57:30.069593 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:57:30.193732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:30.682219 run create_hlr_db(pid=2701): Launched 15:57:30.813172 bus /sierra_2: Setting Powered False 15:57:31.890637 run create_hlr_db(pid=2701): Terminated: ok {rc=0} 15:57:32.368725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2703): Launched 15:57:32.707523 run osmo-hlr_10.42.42.2(pid=2704): Launched 15:57:32.837888 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:33.384383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2706): Launched 15:57:33.700503 run osmo-stp_10.42.42.5(pid=2707): Launched 15:57:33.822336 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:34.394106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2709): Launched 15:57:34.710678 run osmo-msc_10.42.42.6(pid=2710): Launched 15:57:34.885645 run osmo-stp_10.42.42.5(pid=2707): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2707)] 15:57:35.017313 run osmo-stp_10.42.42.5(pid=2707): stdout: | (launched: 2022-12-13_15:57:33.642041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:35.149363 run osmo-stp_10.42.42.5(pid=2707): stderr: | [0;m[38;5;43m20221213155733817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155733817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155733818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155733818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155733818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155733818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155733819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:35.279300 run osmo-stp_10.42.42.5(pid=2707): stdout: | (launched: 2022-12-13_15:57:33.642041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:35.403193 run osmo-stp_10.42.42.5(pid=2707): stderr: | [0;m[38;5;43m20221213155733817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155733817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155733818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155733818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155733818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155733818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155733819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:35.551149 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2707): Process ended prematurely: osmo-stp_10.42.42.5(pid=2707) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2707)] [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:57:35.560225 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:57:35.587033 run osmo-hlr_10.42.42.2(pid=2704): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2704)] 15:57:35.635178 run osmo-hlr_10.42.42.2(pid=2704): stdout: | (launched: 2022-12-13_15:57:32.645035) 15:57:35.685556 run osmo-hlr_10.42.42.2(pid=2704): stderr: | [0;m[1;31m20221213155732848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155732848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155732848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155732848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155732848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155732848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155732860 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155732869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155732869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155732869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:35.754964 run osmo-msc_10.42.42.6(pid=2710): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2710)] 15:57:35.803061 run osmo-msc_10.42.42.6(pid=2710): stdout: | (launched: 2022-12-13_15:57:34.651872) 15:57:35.852902 run osmo-msc_10.42.42.6(pid=2710): stderr: | [0;m[38;5;43m20221213155734925 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155734926 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8307cf5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155734926 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155734926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155734926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155734926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155734928 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155734928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155734928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155734928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:35.903063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2703): Terminating (SIGTERM) 15:57:35.943596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2706): Terminating (SIGTERM) 15:57:35.983735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2709): Terminating (SIGTERM) 15:57:36.024110 --- ParallelTerminationStrategy: PID 2703 died... 15:57:36.043538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2703): Terminated: ok {rc=0} 15:57:36.087815 --- ParallelTerminationStrategy: PID 2706 died... 15:57:36.106749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2706): Terminated: ok {rc=0} 15:57:36.150747 --- ParallelTerminationStrategy: PID 2709 died... 15:57:36.169592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2709): Terminated: ok {rc=0} 15:57:36.256066 bus /sierra_3: Setting Powered False 15:57:37.356552 bus /sierra_3: Setting Powered False 15:57:38.473505 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:57:39.725144 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:57:39.731610 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:57:39.765081 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:57:39.793110 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:57:39.845629 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:57:39.878547 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:57:39.905995 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:57:40.459814 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:57:40.511624 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:40.523199 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:57:40.592729 tst mo_mt_call.py: using LAC 34678 15:57:40.713809 tst mo_mt_call.py: using RAC 253 15:57:40.835212 tst mo_mt_call.py: using CellId 34678 15:57:40.957658 tst mo_mt_call.py: using BVCI 34679 15:57:41.080252 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:41.092172 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:41.103857 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:41.115586 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:41.127493 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:41.139558 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:57:41.260188 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:57:41.378833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:41.866290 run create_hlr_db(pid=2715): Launched 15:57:41.998383 bus /sierra_2: Setting Powered False 15:57:43.059839 run create_hlr_db(pid=2715): Terminated: ok {rc=0} 15:57:43.496122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2717): Launched 15:57:43.812599 run osmo-hlr_10.42.42.2(pid=2718): Launched 15:57:43.932383 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:44.472240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2720): Launched 15:57:44.789433 run osmo-stp_10.42.42.5(pid=2721): Launched 15:57:44.909329 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:45.492051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2723): Launched 15:57:45.808072 run osmo-msc_10.42.42.6(pid=2724): Launched 15:57:46.248625 run osmo-stp_10.42.42.5(pid=2721): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2721)] 15:57:46.437881 run osmo-stp_10.42.42.5(pid=2721): stdout: | (launched: 2022-12-13_15:57:44.730394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:46.571486 run osmo-stp_10.42.42.5(pid=2721): stderr: | [0;m[38;5;43m20221213155744905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155744905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155744905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155744906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155744906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155744906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155744906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:46.704764 run osmo-stp_10.42.42.5(pid=2721): stdout: | (launched: 2022-12-13_15:57:44.730394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:46.842126 run osmo-stp_10.42.42.5(pid=2721): stderr: | [0;m[38;5;43m20221213155744905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155744905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155744905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155744906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155744906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155744906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155744906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:47.007825 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2721): Process ended prematurely: osmo-stp_10.42.42.5(pid=2721) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2721)] [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:57:47.017972 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:57:47.046691 run osmo-hlr_10.42.42.2(pid=2718): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2718)] 15:57:47.102227 run osmo-hlr_10.42.42.2(pid=2718): stdout: | (launched: 2022-12-13_15:57:43.754119) 15:57:47.158651 run osmo-hlr_10.42.42.2(pid=2718): stderr: | [0;m[1;31m20221213155743932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155743932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155743933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155743933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155743933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155743933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155743950 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155743960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155743961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155743961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:47.235298 run osmo-msc_10.42.42.6(pid=2724): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2724)] 15:57:47.287449 run osmo-msc_10.42.42.6(pid=2724): stdout: | (launched: 2022-12-13_15:57:45.749662) 15:57:47.343876 run osmo-msc_10.42.42.6(pid=2724): stderr: | [0;m[38;5;43m20221213155746095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155746095 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5c75169c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155746095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155746095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155746095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155746095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155746097 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155746097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155746098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155746098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:47.397663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2717): Terminating (SIGTERM) 15:57:47.440526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2720): Terminating (SIGTERM) 15:57:47.483964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2723): Terminating (SIGTERM) 15:57:47.527101 --- ParallelTerminationStrategy: PID 2717 died... 15:57:47.547957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2717): Terminated: ok {rc=0} 15:57:47.595756 --- ParallelTerminationStrategy: PID 2720 died... 15:57:47.615924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2720): Terminated: ok {rc=0} 15:57:47.663160 --- ParallelTerminationStrategy: PID 2723 died... 15:57:47.683437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2723): Terminated: ok {rc=0} 15:57:47.773484 bus /sierra_3: Setting Powered False 15:57:48.873759 bus /sierra_3: Setting Powered False 15:57:49.990436 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:57:51.139073 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:51.151132 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:57:51.224634 tst mo_mt_call_osmux.py: using LAC 34679 15:57:51.349216 tst mo_mt_call_osmux.py: using RAC 254 15:57:51.470923 tst mo_mt_call_osmux.py: using CellId 34679 15:57:51.592868 tst mo_mt_call_osmux.py: using BVCI 34680 15:57:51.706098 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:51.717354 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:51.728264 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:51.739238 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:51.750409 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:57:51.761447 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:57:51.883291 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:57:52.003893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:52.492675 run create_hlr_db(pid=2726): Launched 15:57:52.623384 bus /sierra_2: Setting Powered False 15:57:53.685461 run create_hlr_db(pid=2726): Terminated: ok {rc=0} 15:57:54.142989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2728): Launched 15:57:54.480103 run osmo-hlr_10.42.42.2(pid=2729): Launched 15:57:54.611223 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:55.189524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2731): Launched 15:57:55.526578 run osmo-stp_10.42.42.5(pid=2732): Launched 15:57:55.655625 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:56.263543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2734): Launched 15:57:56.603732 run osmo-msc_10.42.42.6(pid=2735): Launched 15:57:56.792702 run osmo-stp_10.42.42.5(pid=2732): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2732)] 15:57:56.933954 run osmo-stp_10.42.42.5(pid=2732): stdout: | (launched: 2022-12-13_15:57:55.464461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:57.075777 run osmo-stp_10.42.42.5(pid=2732): stderr: | [0;m[38;5;43m20221213155755659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155755659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155755659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155755660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155755660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155755660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155755661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:57.216007 run osmo-stp_10.42.42.5(pid=2732): stdout: | (launched: 2022-12-13_15:57:55.464461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:57.349932 run osmo-stp_10.42.42.5(pid=2732): stderr: | [0;m[38;5;43m20221213155755659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155755659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155755659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155755660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155755660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155755660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155755661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:57.509661 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2732): Process ended prematurely: osmo-stp_10.42.42.5(pid=2732) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2732)] [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:57:57.519390 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:57:57.547520 run osmo-hlr_10.42.42.2(pid=2729): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2729)] 15:57:57.599018 run osmo-hlr_10.42.42.2(pid=2729): stdout: | (launched: 2022-12-13_15:57:54.418010) 15:57:57.651760 run osmo-hlr_10.42.42.2(pid=2729): stderr: | [0;m[1;31m20221213155754620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155754620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155754620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155754620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155754620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155754620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155754638 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155754647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155754647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155754647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:57.725313 run osmo-msc_10.42.42.6(pid=2735): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2735)] 15:57:57.775729 run osmo-msc_10.42.42.6(pid=2735): stdout: | (launched: 2022-12-13_15:57:56.541326) 15:57:57.828683 run osmo-msc_10.42.42.6(pid=2735): stderr: | [0;m[38;5;43m20221213155756866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155756866 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3507c8ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155756866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155756866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155756866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155756867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155756870 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155756871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155756871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155756871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:57.881727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2728): Terminating (SIGTERM) 15:57:57.924287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2731): Terminating (SIGTERM) 15:57:57.967377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2734): Terminating (SIGTERM) 15:57:58.010461 --- ParallelTerminationStrategy: PID 2728 died... 15:57:58.031205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2728): Terminated: ok {rc=0} 15:57:58.078053 --- ParallelTerminationStrategy: PID 2731 died... 15:57:58.098260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2731): Terminated: ok {rc=0} 15:57:58.145211 --- ParallelTerminationStrategy: PID 2734 died... 15:57:58.165256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2734): Terminated: ok {rc=0} 15:57:58.254507 bus /sierra_3: Setting Powered False 15:57:59.353124 bus /sierra_3: Setting Powered False 15:58:00.469484 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:58:01.773313 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:58:01.783764 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:58:01.821974 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:58:01.850642 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:58:01.903893 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:58:01.941992 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:58:01.972271 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:58:02.514642 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:58:02.565098 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:02.576428 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:58:02.646249 tst mo_mt_call.py: using LAC 34680 15:58:02.770218 tst mo_mt_call.py: using RAC 255 15:58:02.894816 tst mo_mt_call.py: using CellId 34680 15:58:03.019537 tst mo_mt_call.py: using BVCI 34681 15:58:03.134701 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:03.145928 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:03.156898 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:03.167932 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:03.179002 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:03.190047 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:58:03.311991 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:58:03.431212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:03.919053 run create_hlr_db(pid=2741): Launched 15:58:04.048535 bus /sierra_2: Setting Powered False 15:58:05.111010 run create_hlr_db(pid=2741): Terminated: ok {rc=0} 15:58:05.550420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2743): Launched 15:58:05.866221 run osmo-hlr_10.42.42.2(pid=2744): Launched 15:58:05.987881 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:06.527827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2746): Launched 15:58:06.844783 run osmo-stp_10.42.42.5(pid=2747): Launched 15:58:06.966563 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:07.538861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2749): Launched 15:58:07.855540 run osmo-msc_10.42.42.6(pid=2750): Launched 15:58:08.031597 run osmo-stp_10.42.42.5(pid=2747): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2747)] 15:58:08.164120 run osmo-stp_10.42.42.5(pid=2747): stdout: | (launched: 2022-12-13_15:58:06.786268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:08.297788 run osmo-stp_10.42.42.5(pid=2747): stderr: | [0;m[38;5;43m20221213155806961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155806961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155806961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155806962 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155806962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155806962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155806962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:08.427811 run osmo-stp_10.42.42.5(pid=2747): stdout: | (launched: 2022-12-13_15:58:06.786268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:08.551843 run osmo-stp_10.42.42.5(pid=2747): stderr: | [0;m[38;5;43m20221213155806961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155806961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155806961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155806962 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155806962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155806962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155806962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:08.700748 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2747): Process ended prematurely: osmo-stp_10.42.42.5(pid=2747) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2747)] [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:58:08.710036 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:58:08.736820 run osmo-hlr_10.42.42.2(pid=2744): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2744)] 15:58:08.785101 run osmo-hlr_10.42.42.2(pid=2744): stdout: | (launched: 2022-12-13_15:58:05.807604) 15:58:08.835022 run osmo-hlr_10.42.42.2(pid=2744): stderr: | [0;m[1;31m20221213155805988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155805988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155805988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155805988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155805988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155805988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155806000 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155806008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155806008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155806008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:08.904392 run osmo-msc_10.42.42.6(pid=2750): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2750)] 15:58:08.952529 run osmo-msc_10.42.42.6(pid=2750): stdout: | (launched: 2022-12-13_15:58:07.796707) 15:58:09.002299 run osmo-msc_10.42.42.6(pid=2750): stderr: | [0;m[38;5;43m20221213155808074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155808074 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa247a7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155808074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155808074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155808075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155808075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155808078 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155808079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155808079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155808079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:09.052280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2743): Terminating (SIGTERM) 15:58:09.092152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2746): Terminating (SIGTERM) 15:58:09.132297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2749): Terminating (SIGTERM) 15:58:09.172541 --- ParallelTerminationStrategy: PID 2743 died... 15:58:09.192061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2743): Terminated: ok {rc=0} 15:58:09.236324 --- ParallelTerminationStrategy: PID 2746 died... 15:58:09.255227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2746): Terminated: ok {rc=0} 15:58:09.299305 --- ParallelTerminationStrategy: PID 2749 died... 15:58:09.318147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2749): Terminated: ok {rc=0} 15:58:09.404871 bus /sierra_3: Setting Powered False 15:58:10.506628 bus /sierra_3: Setting Powered False 15:58:11.623796 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:58:12.772853 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:12.784811 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:58:12.855455 tst mo_mt_call_osmux.py: using LAC 34681 15:58:12.977840 tst mo_mt_call_osmux.py: using RAC 1 15:58:13.099423 tst mo_mt_call_osmux.py: using CellId 34681 15:58:13.223811 tst mo_mt_call_osmux.py: using BVCI 34682 15:58:13.339944 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:13.351153 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:13.362147 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:13.373137 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:13.384176 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:58:13.395247 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:58:13.519518 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:58:13.639500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:14.127757 run create_hlr_db(pid=2752): Launched 15:58:14.256370 bus /sierra_2: Setting Powered False 15:58:15.317888 run create_hlr_db(pid=2752): Terminated: ok {rc=0} 15:58:15.776116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2754): Launched 15:58:16.141715 run osmo-hlr_10.42.42.2(pid=2755): Launched 15:58:16.365887 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:17.032015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2757): Launched 15:58:17.366114 run osmo-stp_10.42.42.5(pid=2758): Launched 15:58:17.486745 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:18.067904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2760): Launched 15:58:18.385418 run osmo-msc_10.42.42.6(pid=2761): Launched 15:58:18.561752 run osmo-stp_10.42.42.5(pid=2758): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2758)] 15:58:18.694727 run osmo-stp_10.42.42.5(pid=2758): stdout: | (launched: 2022-12-13_15:58:17.306839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:18.827279 run osmo-stp_10.42.42.5(pid=2758): stderr: | [0;m[38;5;43m20221213155817479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155817479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155817479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155817480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155817483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155817483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155817483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:18.957105 run osmo-stp_10.42.42.5(pid=2758): stdout: | (launched: 2022-12-13_15:58:17.306839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:19.080757 run osmo-stp_10.42.42.5(pid=2758): stderr: | [0;m[38;5;43m20221213155817479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155817479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155817479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155817480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155817483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155817483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155817483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:19.229078 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2758): Process ended prematurely: osmo-stp_10.42.42.5(pid=2758) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2758)] [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:58:19.238188 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:58:19.264809 run osmo-hlr_10.42.42.2(pid=2755): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2755)] 15:58:19.313244 run osmo-hlr_10.42.42.2(pid=2755): stdout: | (launched: 2022-12-13_15:58:16.074341) 15:58:19.363119 run osmo-hlr_10.42.42.2(pid=2755): stderr: | [0;m[1;31m20221213155816292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155816292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155816292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155816292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155816292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155816292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155816312 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155816343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155816343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155816343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:19.432801 run osmo-msc_10.42.42.6(pid=2761): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2761)] 15:58:19.480605 run osmo-msc_10.42.42.6(pid=2761): stdout: | (launched: 2022-12-13_15:58:18.326628) 15:58:19.530305 run osmo-msc_10.42.42.6(pid=2761): stderr: | [0;m[38;5;43m20221213155818603 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155818603 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4464810c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155818603 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155818603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155818603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155818604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155818605 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155818606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155818606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155818606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:19.580727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2754): Terminating (SIGTERM) 15:58:19.620905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2757): Terminating (SIGTERM) 15:58:19.661103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2760): Terminating (SIGTERM) 15:58:19.701960 --- ParallelTerminationStrategy: PID 2754 died... 15:58:19.721235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2754): Terminated: ok {rc=0} 15:58:19.765719 --- ParallelTerminationStrategy: PID 2757 died... 15:58:19.784369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2757): Terminated: ok {rc=0} 15:58:19.828632 --- ParallelTerminationStrategy: PID 2760 died... 15:58:19.847521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2760): Terminated: ok {rc=0} 15:58:19.933965 bus /sierra_3: Setting Powered False 15:58:21.035154 bus /sierra_3: Setting Powered False 15:58:22.154735 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:58:23.407324 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:58:23.414404 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:58:23.447666 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:58:23.475284 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:58:23.528161 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:58:23.563712 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:58:23.592425 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:58:24.139934 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:58:24.197295 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:24.209131 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:58:24.282695 tst mo_mt_call.py: using LAC 34682 15:58:24.417195 tst mo_mt_call.py: using RAC 2 15:58:24.550463 tst mo_mt_call.py: using CellId 34682 15:58:24.675727 tst mo_mt_call.py: using BVCI 34683 15:58:24.791214 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:24.802652 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:24.813866 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:24.824922 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:24.836155 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:24.847139 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:58:24.971595 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:58:25.091257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:25.581735 run create_hlr_db(pid=2768): Launched 15:58:25.711697 bus /sierra_2: Setting Powered False 15:58:26.777538 run create_hlr_db(pid=2768): Terminated: ok {rc=0} 15:58:27.244790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2770): Launched 15:58:27.582438 run osmo-hlr_10.42.42.2(pid=2771): Launched 15:58:27.713348 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:28.292519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2773): Launched 15:58:28.631123 run osmo-stp_10.42.42.5(pid=2774): Launched 15:58:28.762617 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:29.371086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2776): Launched 15:58:29.707374 run osmo-msc_10.42.42.6(pid=2777): Launched 15:58:29.896305 run osmo-stp_10.42.42.5(pid=2774): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2774)] 15:58:30.037954 run osmo-stp_10.42.42.5(pid=2774): stdout: | (launched: 2022-12-13_15:58:28.568741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:30.179645 run osmo-stp_10.42.42.5(pid=2774): stderr: | [0;m[38;5;43m20221213155828764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155828764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155828764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155828765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155828767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155828767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155828767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:30.320316 run osmo-stp_10.42.42.5(pid=2774): stdout: | (launched: 2022-12-13_15:58:28.568741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:30.453535 run osmo-stp_10.42.42.5(pid=2774): stderr: | [0;m[38;5;43m20221213155828764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155828764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155828764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155828765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155828767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155828767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155828767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:30.613452 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2774): Process ended prematurely: osmo-stp_10.42.42.5(pid=2774) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2774)] [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:58:30.623180 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:58:30.651505 run osmo-hlr_10.42.42.2(pid=2771): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2771)] 15:58:30.703012 run osmo-hlr_10.42.42.2(pid=2771): stdout: | (launched: 2022-12-13_15:58:27.519926) 15:58:30.755697 run osmo-hlr_10.42.42.2(pid=2771): stderr: | [0;m[1;31m20221213155827721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155827721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155827721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155827721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155827721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155827721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155827733 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155827742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155827742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155827742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:30.831404 run osmo-msc_10.42.42.6(pid=2777): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2777)] 15:58:30.895084 run osmo-msc_10.42.42.6(pid=2777): stdout: | (launched: 2022-12-13_15:58:29.645218) 15:58:30.949478 run osmo-msc_10.42.42.6(pid=2777): stderr: | [0;m[38;5;43m20221213155829971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155829971 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f311b22ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155829971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155829971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155829971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155829971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155829973 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155829973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155829974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155829974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:31.005180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2770): Terminating (SIGTERM) 15:58:31.048695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2773): Terminating (SIGTERM) 15:58:31.093456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2776): Terminating (SIGTERM) 15:58:31.138878 --- ParallelTerminationStrategy: PID 2770 died... 15:58:31.161179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2770): Terminated: ok {rc=0} 15:58:31.211414 --- ParallelTerminationStrategy: PID 2773 died... 15:58:31.233501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2773): Terminated: ok {rc=0} 15:58:31.282996 --- ParallelTerminationStrategy: PID 2776 died... 15:58:31.304746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2776): Terminated: ok {rc=0} 15:58:31.405452 bus /sierra_3: Setting Powered False 15:58:32.521337 bus /sierra_3: Setting Powered False 15:58:33.639314 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:58:34.791385 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:34.804014 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:58:34.877236 tst mo_mt_call_osmux.py: using LAC 34683 15:58:35.007406 tst mo_mt_call_osmux.py: using RAC 3 15:58:35.138341 tst mo_mt_call_osmux.py: using CellId 34683 15:58:35.269112 tst mo_mt_call_osmux.py: using BVCI 34684 15:58:35.392665 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:35.404406 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:35.416293 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:35.427848 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:35.439798 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:58:35.451631 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:58:35.573477 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:58:35.694429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:36.183618 run create_hlr_db(pid=2779): Launched 15:58:36.314447 bus /sierra_2: Setting Powered False 15:58:37.380009 run create_hlr_db(pid=2779): Terminated: ok {rc=0} 15:58:37.847642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2781): Launched 15:58:38.187335 run osmo-hlr_10.42.42.2(pid=2782): Launched 15:58:38.318535 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:38.898690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2784): Launched 15:58:39.234867 run osmo-stp_10.42.42.5(pid=2785): Launched 15:58:39.365534 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:39.972284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2787): Launched 15:58:40.310441 run osmo-msc_10.42.42.6(pid=2788): Launched 15:58:40.498551 run osmo-stp_10.42.42.5(pid=2785): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2785)] 15:58:40.639904 run osmo-stp_10.42.42.5(pid=2785): stdout: | (launched: 2022-12-13_15:58:39.172868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:40.781501 run osmo-stp_10.42.42.5(pid=2785): stderr: | [0;m[38;5;43m20221213155839367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155839367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155839367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155839368 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155839370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155839370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155839370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:40.921450 run osmo-stp_10.42.42.5(pid=2785): stdout: | (launched: 2022-12-13_15:58:39.172868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:41.054605 run osmo-stp_10.42.42.5(pid=2785): stderr: | [0;m[38;5;43m20221213155839367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155839367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155839367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155839368 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155839370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155839370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155839370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:41.214099 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2785): Process ended prematurely: osmo-stp_10.42.42.5(pid=2785) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2785)] [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:58:41.223689 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:58:41.251980 run osmo-hlr_10.42.42.2(pid=2782): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2782)] 15:58:41.303519 run osmo-hlr_10.42.42.2(pid=2782): stdout: | (launched: 2022-12-13_15:58:38.124907) 15:58:41.356490 run osmo-hlr_10.42.42.2(pid=2782): stderr: | [0;m[1;31m20221213155838324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155838324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155838324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155838324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155838324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155838325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155838340 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155838350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155838350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155838350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:41.430182 run osmo-msc_10.42.42.6(pid=2788): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2788)] 15:58:41.480676 run osmo-msc_10.42.42.6(pid=2788): stdout: | (launched: 2022-12-13_15:58:40.247104) 15:58:41.533442 run osmo-msc_10.42.42.6(pid=2788): stderr: | [0;m[38;5;43m20221213155840579 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155840579 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcbd0365c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155840579 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155840579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155840580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155840580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155840581 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155840582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155840582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155840582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:41.586620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2781): Terminating (SIGTERM) 15:58:41.629349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2784): Terminating (SIGTERM) 15:58:41.672202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2787): Terminating (SIGTERM) 15:58:41.715194 --- ParallelTerminationStrategy: PID 2781 died... 15:58:41.735694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2781): Terminated: ok {rc=0} 15:58:41.782683 --- ParallelTerminationStrategy: PID 2784 died... 15:58:41.802639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2784): Terminated: ok {rc=0} 15:58:41.849361 --- ParallelTerminationStrategy: PID 2787 died... 15:58:41.869399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2787): Terminated: ok {rc=0} 15:58:41.958091 bus /sierra_3: Setting Powered False 15:58:43.056780 bus /sierra_3: Setting Powered False 15:58:44.173311 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:58:45.423771 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:58:45.430482 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:58:45.463997 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:58:45.491661 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:58:45.543885 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:58:45.577351 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:58:45.604266 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:58:46.160040 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:58:46.212292 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:46.224257 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:58:46.295083 tst mo_mt_call.py: using LAC 34684 15:58:46.461869 tst mo_mt_call.py: using RAC 4 15:58:46.597310 tst mo_mt_call.py: using CellId 34684 15:58:46.723533 tst mo_mt_call.py: using BVCI 34685 15:58:46.854532 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:46.867243 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:46.879919 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:46.892568 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:46.906474 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:46.920053 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:58:47.048157 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:58:47.167477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:47.692866 run create_hlr_db(pid=2793): Launched 15:58:47.823206 bus /sierra_2: Setting Powered False 15:58:48.888717 run create_hlr_db(pid=2793): Terminated: ok {rc=0} 15:58:49.336556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2795): Launched 15:58:49.655515 run osmo-hlr_10.42.42.2(pid=2796): Launched 15:58:49.776796 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:50.317435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2798): Launched 15:58:50.633544 run osmo-stp_10.42.42.5(pid=2799): Launched 15:58:50.752813 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:51.333920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2801): Launched 15:58:51.649587 run osmo-msc_10.42.42.6(pid=2802): Launched 15:58:51.825250 run osmo-stp_10.42.42.5(pid=2799): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2799)] 15:58:51.957304 run osmo-stp_10.42.42.5(pid=2799): stdout: | (launched: 2022-12-13_15:58:50.574909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:52.088754 run osmo-stp_10.42.42.5(pid=2799): stderr: | [0;m[38;5;43m20221213155850749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155850749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155850749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155850749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155850750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155850750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155850750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:52.218577 run osmo-stp_10.42.42.5(pid=2799): stdout: | (launched: 2022-12-13_15:58:50.574909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:52.342085 run osmo-stp_10.42.42.5(pid=2799): stderr: | [0;m[38;5;43m20221213155850749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155850749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155850749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155850749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155850750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155850750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155850750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:52.490107 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2799): Process ended prematurely: osmo-stp_10.42.42.5(pid=2799) [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2799)] [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:58:52.499224 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:58:52.526154 run osmo-hlr_10.42.42.2(pid=2796): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2796)] 15:58:52.574515 run osmo-hlr_10.42.42.2(pid=2796): stdout: | (launched: 2022-12-13_15:58:49.596593) 15:58:52.624086 run osmo-hlr_10.42.42.2(pid=2796): stderr: | [0;m[1;31m20221213155849776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155849776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155849776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155849776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155849776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155849776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155849791 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155849800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155849800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155849800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:52.693544 run osmo-msc_10.42.42.6(pid=2802): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2802)] 15:58:52.741385 run osmo-msc_10.42.42.6(pid=2802): stdout: | (launched: 2022-12-13_15:58:51.591077) 15:58:52.791071 run osmo-msc_10.42.42.6(pid=2802): stderr: | [0;m[38;5;43m20221213155851864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155851864 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f046ef83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155851864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155851865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155851865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155851865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155851867 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155851867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155851867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155851867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:52.841597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2795): Terminating (SIGTERM) 15:58:52.881393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2798): Terminating (SIGTERM) 15:58:52.921455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2801): Terminating (SIGTERM) 15:58:52.961782 --- ParallelTerminationStrategy: PID 2795 died... 15:58:52.981304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2795): Terminated: ok {rc=0} 15:58:53.025638 --- ParallelTerminationStrategy: PID 2798 died... 15:58:53.044265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2798): Terminated: ok {rc=0} 15:58:53.088423 --- ParallelTerminationStrategy: PID 2801 died... 15:58:53.107429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2801): Terminated: ok {rc=0} 15:58:53.193463 bus /sierra_3: Setting Powered False 15:58:54.293522 bus /sierra_3: Setting Powered False 15:58:55.408882 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:58:56.559790 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:56.572319 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:58:56.646296 tst mo_mt_call_osmux.py: using LAC 34685 15:58:56.778364 tst mo_mt_call_osmux.py: using RAC 5 15:58:56.910328 tst mo_mt_call_osmux.py: using CellId 34685 15:58:57.042477 tst mo_mt_call_osmux.py: using BVCI 34686 15:58:57.166599 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:57.178373 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:57.189920 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:57.201450 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:57.213600 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:58:57.225449 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:58:57.347953 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:58:57.469743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:57.991471 run create_hlr_db(pid=2804): Launched 15:58:58.119403 bus /sierra_2: Setting Powered False 15:58:59.185338 run create_hlr_db(pid=2804): Terminated: ok {rc=0} 15:58:59.651543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2806): Launched 15:58:59.988829 run osmo-hlr_10.42.42.2(pid=2807): Launched 15:59:00.119074 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:00.700525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2809): Launched 15:59:01.047086 run osmo-stp_10.42.42.5(pid=2810): Launched 15:59:01.448906 run osmo-msc_10.42.42.6: Starting osmo-msc 15:59:02.153095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2812): Launched 15:59:02.503812 run osmo-msc_10.42.42.6(pid=2813): Launched 15:59:02.693780 run osmo-stp_10.42.42.5(pid=2810): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2810)] 15:59:02.834924 run osmo-stp_10.42.42.5(pid=2810): stdout: | (launched: 2022-12-13_15:59:00.987343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:02.976734 run osmo-stp_10.42.42.5(pid=2810): stderr: | [0;m[38;5;43m20221213155901301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155901301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155901302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155901304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155901305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155901305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155901305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:03.115830 run osmo-stp_10.42.42.5(pid=2810): stdout: | (launched: 2022-12-13_15:59:00.987343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:03.248649 run osmo-stp_10.42.42.5(pid=2810): stderr: | [0;m[38;5;43m20221213155901301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155901301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155901302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155901304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155901305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155901305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155901305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:03.408602 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2810): Process ended prematurely: osmo-stp_10.42.42.5(pid=2810) [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2810)] [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:59:03.418633 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 15:59:03.446619 run osmo-hlr_10.42.42.2(pid=2807): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2807)] 15:59:03.498368 run osmo-hlr_10.42.42.2(pid=2807): stdout: | (launched: 2022-12-13_15:58:59.926782) 15:59:03.551398 run osmo-hlr_10.42.42.2(pid=2807): stderr: | [0;m[1;31m20221213155900126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155900127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155900127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155900127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155900127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155900127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155900139 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155900148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155900148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155900148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:03.624684 run osmo-msc_10.42.42.6(pid=2813): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2813)] 15:59:03.675295 run osmo-msc_10.42.42.6(pid=2813): stdout: | (launched: 2022-12-13_15:59:02.442081) 15:59:03.727836 run osmo-msc_10.42.42.6(pid=2813): stderr: | [0;m[38;5;43m20221213155902767 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155902767 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f83c1f9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155902767 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155902767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155902768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155902768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155902770 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155902770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155902770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155902770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:59:03.781136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2806): Terminating (SIGTERM) 15:59:03.823362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2809): Terminating (SIGTERM) 15:59:03.866560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2812): Terminating (SIGTERM) 15:59:03.909424 --- ParallelTerminationStrategy: PID 2806 died... 15:59:03.929977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2806): Terminated: ok {rc=0} 15:59:03.976452 --- ParallelTerminationStrategy: PID 2809 died... 15:59:03.996531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2809): Terminated: ok {rc=0} 15:59:04.042934 --- ParallelTerminationStrategy: PID 2812 died... 15:59:04.063031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2812): Terminated: ok {rc=0} 15:59:04.151875 bus /sierra_3: Setting Powered False 15:59:05.250707 bus /sierra_3: Setting Powered False 15:59:06.367111 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:59:07.620569 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:59:07.626787 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:59:07.659923 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:59:07.686776 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:59:07.739345 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:59:07.774193 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:59:07.802488 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:59:08.348678 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:59:08.405133 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:08.416740 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:59:08.491094 tst mo_mt_call.py: using LAC 34686 15:59:08.622612 tst mo_mt_call.py: using RAC 6 15:59:08.756479 tst mo_mt_call.py: using CellId 34686 15:59:08.888375 tst mo_mt_call.py: using BVCI 34687 15:59:09.011164 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:09.022732 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:09.034279 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:09.045710 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:09.057904 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:09.070228 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:59:09.191869 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:59:09.315398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:09.837594 run create_hlr_db(pid=2819): Launched 15:59:09.965911 bus /sierra_2: Setting Powered False 15:59:11.028310 run create_hlr_db(pid=2819): Terminated: ok {rc=0} 15:59:11.498462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2821): Launched 15:59:11.835888 run osmo-hlr_10.42.42.2(pid=2822): Launched 15:59:11.969800 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:12.555876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2824): Launched 15:59:12.894621 run osmo-stp_10.42.42.5(pid=2825): Launched 15:59:13.025995 run osmo-msc_10.42.42.6: Starting osmo-msc 15:59:13.634425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2827): Launched 15:59:13.973354 run osmo-msc_10.42.42.6(pid=2828): Launched 15:59:14.161868 run osmo-stp_10.42.42.5(pid=2825): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2825)] 15:59:14.306544 run osmo-stp_10.42.42.5(pid=2825): stdout: | (launched: 2022-12-13_15:59:12.832224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:14.448318 run osmo-stp_10.42.42.5(pid=2825): stderr: | [0;m[38;5;43m20221213155913028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155913028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155913028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155913028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155913029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155913029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155913029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:14.587943 run osmo-stp_10.42.42.5(pid=2825): stdout: | (launched: 2022-12-13_15:59:12.832224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:14.721308 run osmo-stp_10.42.42.5(pid=2825): stderr: | [0;m[38;5;43m20221213155913028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155913028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155913028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155913028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155913029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155913029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155913029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:14.880918 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2825): Process ended prematurely: osmo-stp_10.42.42.5(pid=2825) [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2825)] [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:59:14.890847 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:59:14.919484 run osmo-hlr_10.42.42.2(pid=2822): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2822)] 15:59:14.971073 run osmo-hlr_10.42.42.2(pid=2822): stdout: | (launched: 2022-12-13_15:59:11.773851) 15:59:15.023810 run osmo-hlr_10.42.42.2(pid=2822): stderr: | [0;m[1;31m20221213155912041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155912041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155912041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155912041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155912041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155912041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155912055 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155912063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155912063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155912064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:15.097557 run osmo-msc_10.42.42.6(pid=2828): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2828)] 15:59:15.148418 run osmo-msc_10.42.42.6(pid=2828): stdout: | (launched: 2022-12-13_15:59:13.911275) 15:59:15.201261 run osmo-msc_10.42.42.6(pid=2828): stderr: | [0;m[38;5;43m20221213155914234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155914234 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f415fa35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155914234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155914234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155914234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155914235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155914236 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155914237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155914237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155914237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:59:15.254539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2821): Terminating (SIGTERM) 15:59:15.297773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2824): Terminating (SIGTERM) 15:59:15.341221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2827): Terminating (SIGTERM) 15:59:15.384087 --- ParallelTerminationStrategy: PID 2821 died... 15:59:15.404579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2821): Terminated: ok {rc=0} 15:59:15.451868 --- ParallelTerminationStrategy: PID 2824 died... 15:59:15.472148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2824): Terminated: ok {rc=0} 15:59:15.518999 --- ParallelTerminationStrategy: PID 2827 died... 15:59:15.539179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2827): Terminated: ok {rc=0} 15:59:15.629758 bus /sierra_3: Setting Powered False 15:59:16.735774 bus /sierra_3: Setting Powered False 15:59:17.862610 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:59:19.015618 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:19.027866 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:59:19.101373 tst mo_mt_call_osmux.py: using LAC 34687 15:59:19.233636 tst mo_mt_call_osmux.py: using RAC 7 15:59:19.363159 tst mo_mt_call_osmux.py: using CellId 34687 15:59:19.486743 tst mo_mt_call_osmux.py: using BVCI 34688 15:59:19.603251 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:19.614652 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:19.625846 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:19.636780 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:19.648127 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:59:19.659272 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:59:19.778728 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:59:19.901708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:20.424625 run create_hlr_db(pid=2830): Launched 15:59:20.555554 bus /sierra_2: Setting Powered False 15:59:21.621684 run create_hlr_db(pid=2830): Terminated: ok {rc=0} 15:59:22.072637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2833): Launched 15:59:22.392061 run osmo-hlr_10.42.42.2(pid=2834): Launched 15:59:22.514239 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:23.071690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2836): Launched 15:59:23.391709 run osmo-stp_10.42.42.5(pid=2837): Launched 15:59:23.514763 run osmo-msc_10.42.42.6: Starting osmo-msc 15:59:24.085704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2839): Launched 15:59:24.403480 run osmo-msc_10.42.42.6(pid=2840): Launched 15:59:24.581950 run osmo-stp_10.42.42.5(pid=2837): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2837)] 15:59:24.713929 run osmo-stp_10.42.42.5(pid=2837): stdout: | (launched: 2022-12-13_15:59:23.332190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:24.847213 run osmo-stp_10.42.42.5(pid=2837): stderr: | [0;m[38;5;43m20221213155923507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155923508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155923508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155923508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155923509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155923509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155923509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:24.977593 run osmo-stp_10.42.42.5(pid=2837): stdout: | (launched: 2022-12-13_15:59:23.332190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:25.101869 run osmo-stp_10.42.42.5(pid=2837): stderr: | [0;m[38;5;43m20221213155923507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155923508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155923508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155923508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155923509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155923509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155923509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:25.251333 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2837): Process ended prematurely: osmo-stp_10.42.42.5(pid=2837) [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2837)] [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:59:25.260204 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:59:25.287144 run osmo-hlr_10.42.42.2(pid=2834): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2834)] 15:59:25.335665 run osmo-hlr_10.42.42.2(pid=2834): stdout: | (launched: 2022-12-13_15:59:22.332548) 15:59:25.386002 run osmo-hlr_10.42.42.2(pid=2834): stderr: | [0;m[1;31m20221213155922512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155922513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155922513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155922513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155922513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155922513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155922525 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155922533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155922533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155922533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:25.456165 run osmo-msc_10.42.42.6(pid=2840): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2840)] 15:59:25.504617 run osmo-msc_10.42.42.6(pid=2840): stdout: | (launched: 2022-12-13_15:59:24.344461) 15:59:25.554832 run osmo-msc_10.42.42.6(pid=2840): stderr: | [0;m[38;5;43m20221213155924619 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155924619 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f24b33b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155924619 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155924619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155924620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155924620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155924622 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155924622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155924622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155924622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:59:25.605702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2833): Terminating (SIGTERM) 15:59:25.645972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2836): Terminating (SIGTERM) 15:59:25.686339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2839): Terminating (SIGTERM) 15:59:25.726882 --- ParallelTerminationStrategy: PID 2833 died... 15:59:25.746263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2833): Terminated: ok {rc=0} 15:59:25.790912 --- ParallelTerminationStrategy: PID 2836 died... 15:59:25.809958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2836): Terminated: ok {rc=0} 15:59:25.854466 --- ParallelTerminationStrategy: PID 2839 died... 15:59:25.873383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2839): Terminated: ok {rc=0} 15:59:25.960630 bus /sierra_3: Setting Powered False 15:59:27.061574 bus /sierra_3: Setting Powered False 15:59:28.178363 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 15:59:29.439745 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:59:29.446455 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 15:59:29.479922 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 15:59:29.506565 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 15:59:29.557230 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 15:59:29.590427 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 15:59:29.617034 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 15:59:30.168309 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 15:59:30.218562 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:30.229841 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 15:59:30.279356 tst mo_mt_call.py: using LAC 34688 15:59:30.401118 tst mo_mt_call.py: using RAC 8 15:59:30.522352 tst mo_mt_call.py: using CellId 34688 15:59:30.645380 tst mo_mt_call.py: using BVCI 34689 15:59:30.761407 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:30.772365 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:30.783233 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:30.794114 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:30.804869 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:30.816171 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:59:30.957650 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:59:31.101739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:31.639613 run create_hlr_db(pid=2845): Launched 15:59:31.805894 bus /sierra_2: Setting Powered False 15:59:32.872181 run create_hlr_db(pid=2845): Terminated: ok {rc=0} 15:59:33.342082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2847): Launched 15:59:33.682561 run osmo-hlr_10.42.42.2(pid=2848): Launched 15:59:33.810995 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:34.390725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2850): Launched 15:59:34.727514 run osmo-stp_10.42.42.5(pid=2851): Launched 15:59:34.858000 run osmo-msc_10.42.42.6: Starting osmo-msc 15:59:35.465328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2853): Launched 15:59:35.803709 run osmo-msc_10.42.42.6(pid=2854): Launched 15:59:35.992783 run osmo-stp_10.42.42.5(pid=2851): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2851)] 15:59:36.134089 run osmo-stp_10.42.42.5(pid=2851): stdout: | (launched: 2022-12-13_15:59:34.665412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:36.275876 run osmo-stp_10.42.42.5(pid=2851): stderr: | [0;m[38;5;43m20221213155934862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155934862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155934862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155934863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155934863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155934863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155934863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:36.415973 run osmo-stp_10.42.42.5(pid=2851): stdout: | (launched: 2022-12-13_15:59:34.665412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:36.549115 run osmo-stp_10.42.42.5(pid=2851): stderr: | [0;m[38;5;43m20221213155934862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155934862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155934862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155934863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155934863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155934863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155934863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:36.708647 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2851): Process ended prematurely: osmo-stp_10.42.42.5(pid=2851) [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2851)] [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 15:59:36.718705 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:59:36.746829 run osmo-hlr_10.42.42.2(pid=2848): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2848)] 15:59:36.798152 run osmo-hlr_10.42.42.2(pid=2848): stdout: | (launched: 2022-12-13_15:59:33.619717) 15:59:36.850689 run osmo-hlr_10.42.42.2(pid=2848): stderr: | [0;m[1;31m20221213155933821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155933821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155933821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155933821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155933821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155933821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155933835 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155933845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155933845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155933845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:36.924595 run osmo-msc_10.42.42.6(pid=2854): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2854)] 15:59:36.975158 run osmo-msc_10.42.42.6(pid=2854): stdout: | (launched: 2022-12-13_15:59:35.741521) 15:59:37.027556 run osmo-msc_10.42.42.6(pid=2854): stderr: | [0;m[38;5;43m20221213155936065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155936065 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2db9050c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155936065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155936066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155936066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155936066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155936067 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155936068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155936068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155936068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:59:37.080545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2847): Terminating (SIGTERM) 15:59:37.122993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2850): Terminating (SIGTERM) 15:59:37.166215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2853): Terminating (SIGTERM) 15:59:37.209127 --- ParallelTerminationStrategy: PID 2847 died... 15:59:37.229680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2847): Terminated: ok {rc=0} 15:59:37.276371 --- ParallelTerminationStrategy: PID 2850 died... 15:59:37.296762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2850): Terminated: ok {rc=0} 15:59:37.343409 --- ParallelTerminationStrategy: PID 2853 died... 15:59:37.364016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2853): Terminated: ok {rc=0} 15:59:37.452537 bus /sierra_3: Setting Powered False 15:59:38.553307 bus /sierra_3: Setting Powered False 15:59:39.670697 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 15:59:40.822597 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:40.835027 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 15:59:40.891592 tst mo_mt_call_osmux.py: using LAC 34689 15:59:41.022300 tst mo_mt_call_osmux.py: using RAC 9 15:59:41.154352 tst mo_mt_call_osmux.py: using CellId 34689 15:59:41.276715 tst mo_mt_call_osmux.py: using BVCI 34690 15:59:41.390432 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:41.401607 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:41.412523 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:41.423374 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:41.434237 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:59:41.445178 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:59:41.563223 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:59:41.685911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:42.205834 run create_hlr_db(pid=2856): Launched 15:59:42.335345 bus /sierra_2: Setting Powered False 15:59:43.401249 run create_hlr_db(pid=2856): Terminated: ok {rc=0} 15:59:43.868367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2858): Launched 15:59:44.206253 run osmo-hlr_10.42.42.2(pid=2859): Launched 15:59:44.337655 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:44.917309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2861): Launched 15:59:45.257530 run osmo-stp_10.42.42.5(pid=2862): Launched 15:59:45.389498 run osmo-msc_10.42.42.6: Starting osmo-msc 15:59:45.999515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2864): Launched 15:59:46.387813 run osmo-msc_10.42.42.6(pid=2865): Launched 15:59:46.710893 run osmo-stp_10.42.42.5(pid=2862): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2862)] 15:59:47.007739 run osmo-stp_10.42.42.5(pid=2862): stdout: | (launched: 2022-12-13_15:59:45.195048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:47.177281 run osmo-stp_10.42.42.5(pid=2862): stderr: | [0;m[38;5;43m20221213155945391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155945392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155945392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155945392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155945393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155945393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155945393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:47.325733 run osmo-stp_10.42.42.5(pid=2862): stdout: | (launched: 2022-12-13_15:59:45.195048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:47.465226 run osmo-stp_10.42.42.5(pid=2862): stderr: | [0;m[38;5;43m20221213155945391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155945392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155945392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155945392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155945393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155945393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155945393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:47.614882 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2862): Process ended prematurely: osmo-stp_10.42.42.5(pid=2862) [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2862)] [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 15:59:47.623832 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 15:59:47.650368 run osmo-hlr_10.42.42.2(pid=2859): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2859)] 15:59:47.698523 run osmo-hlr_10.42.42.2(pid=2859): stdout: | (launched: 2022-12-13_15:59:44.143799) 15:59:47.748200 run osmo-hlr_10.42.42.2(pid=2859): stderr: | [0;m[1;31m20221213155944345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155944345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155944345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155944345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155944345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155944346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155944358 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155944367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155944367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155944368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:47.817748 run osmo-msc_10.42.42.6(pid=2865): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2865)] 15:59:47.865676 run osmo-msc_10.42.42.6(pid=2865): stdout: | (launched: 2022-12-13_15:59:46.325678) 15:59:47.915667 run osmo-msc_10.42.42.6(pid=2865): stderr: | [0;m[38;5;43m20221213155946795 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155946795 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff7d1b4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155946796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155946796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155946796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155946796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155946798 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155946798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155946798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155946798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:59:47.965849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2858): Terminating (SIGTERM) 15:59:48.005957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2861): Terminating (SIGTERM) 15:59:48.046153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2864): Terminating (SIGTERM) 15:59:48.086765 --- ParallelTerminationStrategy: PID 2858 died... 15:59:48.106002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2858): Terminated: ok {rc=0} 15:59:48.150154 --- ParallelTerminationStrategy: PID 2861 died... 15:59:48.168845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2861): Terminated: ok {rc=0} 15:59:48.212857 --- ParallelTerminationStrategy: PID 2864 died... 15:59:48.231957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2864): Terminated: ok {rc=0} 15:59:48.316521 bus /sierra_3: Setting Powered False 15:59:49.413304 bus /sierra_3: Setting Powered False 15:59:50.526343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 15:59:51.782977 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:59:51.789918 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 15:59:51.825556 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 15:59:51.853683 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 15:59:51.907204 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 15:59:51.941599 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 15:59:51.969467 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 15:59:52.521336 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 15:59:52.571280 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:59:52.582729 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 15:59:52.635260 tst mo_mt_call.py: using LAC 34690 15:59:52.759935 tst mo_mt_call.py: using RAC 10 15:59:52.885124 tst mo_mt_call.py: using CellId 34690 15:59:53.008731 tst mo_mt_call.py: using BVCI 34691 15:59:53.132108 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:59:53.144049 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:59:53.155897 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:59:53.167791 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:59:53.179965 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:59:53.192046 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:59:53.311735 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:59:53.434638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:53.955498 run create_hlr_db(pid=2870): Launched 15:59:54.084428 bus /sierra_2: Setting Powered False 15:59:55.150989 run create_hlr_db(pid=2870): Terminated: ok {rc=0} 15:59:55.603205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Launched 15:59:55.921225 run osmo-hlr_10.42.42.2(pid=2873): Launched 15:59:56.041780 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:56.584012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Launched 15:59:56.902709 run osmo-stp_10.42.42.5(pid=2876): Launched 15:59:57.024243 run osmo-msc_10.42.42.6: Starting osmo-msc 15:59:57.596200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2878): Launched 15:59:57.915601 run osmo-msc_10.42.42.6(pid=2879): Launched 15:59:58.093217 run osmo-stp_10.42.42.5(pid=2876): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2876)] 15:59:58.225164 run osmo-stp_10.42.42.5(pid=2876): stdout: | (launched: 2022-12-13_15:59:56.843334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:58.357608 run osmo-stp_10.42.42.5(pid=2876): stderr: | [0;m[38;5;43m20221213155957017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155957017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155957018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155957018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155957020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155957020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155957021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:58.488636 run osmo-stp_10.42.42.5(pid=2876): stdout: | (launched: 2022-12-13_15:59:56.843334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:58.613265 run osmo-stp_10.42.42.5(pid=2876): stderr: | [0;m[38;5;43m20221213155957017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213155957017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213155957018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213155957018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213155957020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213155957020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213155957021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:58.762806 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2876): Process ended prematurely: osmo-stp_10.42.42.5(pid=2876) [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2876)] [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 15:59:58.771737 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:59:58.798406 run osmo-hlr_10.42.42.2(pid=2873): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2873)] 15:59:58.846418 run osmo-hlr_10.42.42.2(pid=2873): stdout: | (launched: 2022-12-13_15:59:55.862133) 15:59:58.895970 run osmo-hlr_10.42.42.2(pid=2873): stderr: | [0;m[1;31m20221213155956043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213155956043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213155956043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213155956044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213155956044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213155956044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213155956056 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213155956065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213155956065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213155956065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:58.965509 run osmo-msc_10.42.42.6(pid=2879): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2879)] 15:59:59.013648 run osmo-msc_10.42.42.6(pid=2879): stdout: | (launched: 2022-12-13_15:59:57.856281) 15:59:59.064034 run osmo-msc_10.42.42.6(pid=2879): stderr: | [0;m[38;5;43m20221213155958131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213155958131 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3d24398c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213155958131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213155958131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213155958131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213155958132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213155958133 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213155958134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213155958134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213155958134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:59:59.114200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Terminating (SIGTERM) 15:59:59.154111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Terminating (SIGTERM) 15:59:59.194189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2878): Terminating (SIGTERM) 15:59:59.234691 --- ParallelTerminationStrategy: PID 2872 died... 15:59:59.253817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Terminated: ok {rc=0} 15:59:59.297934 --- ParallelTerminationStrategy: PID 2875 died... 15:59:59.316520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Terminated: ok {rc=0} 15:59:59.361100 --- ParallelTerminationStrategy: PID 2878 died... 15:59:59.380223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2878): Terminated: ok {rc=0} 15:59:59.464822 bus /sierra_3: Setting Powered False 16:00:00.563245 bus /sierra_3: Setting Powered False 16:00:01.685581 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 16:00:02.841916 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:00:02.854225 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:00:02.908572 tst mo_mt_call_osmux.py: using LAC 34691 16:00:03.031606 tst mo_mt_call_osmux.py: using RAC 11 16:00:03.156888 tst mo_mt_call_osmux.py: using CellId 34691 16:00:03.281274 tst mo_mt_call_osmux.py: using BVCI 34692 16:00:03.397097 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:00:03.408552 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:00:03.419797 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:00:03.430996 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:00:03.442371 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:00:03.453701 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:00:03.572895 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:00:03.699034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:04.187756 run create_hlr_db(pid=2891): Launched 16:00:04.317979 bus /sierra_2: Setting Powered False 16:00:05.380085 run create_hlr_db(pid=2891): Terminated: ok {rc=0} 16:00:05.837316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2893): Launched 16:00:06.175453 run osmo-hlr_10.42.42.2(pid=2894): Launched 16:00:06.304899 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:06.883274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2896): Launched 16:00:07.219801 run osmo-stp_10.42.42.5(pid=2897): Launched 16:00:07.359538 run osmo-msc_10.42.42.6: Starting osmo-msc 16:00:07.965586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2899): Launched 16:00:08.303322 run osmo-msc_10.42.42.6(pid=2900): Launched 16:00:08.492025 run osmo-stp_10.42.42.5(pid=2897): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2897)] 16:00:08.632586 run osmo-stp_10.42.42.5(pid=2897): stdout: | (launched: 2022-12-13_16:00:07.157697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:08.774034 run osmo-stp_10.42.42.5(pid=2897): stderr: | [0;m[38;5;43m20221213160007353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160007353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160007354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160007354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160007354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160007355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160007355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:08.913511 run osmo-stp_10.42.42.5(pid=2897): stdout: | (launched: 2022-12-13_16:00:07.157697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:09.046159 run osmo-stp_10.42.42.5(pid=2897): stderr: | [0;m[38;5;43m20221213160007353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160007353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160007354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160007354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160007354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160007355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160007355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:09.205433 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2897): Process ended prematurely: osmo-stp_10.42.42.5(pid=2897) [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2897)] [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 16:00:09.215182 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:00:09.243042 run osmo-hlr_10.42.42.2(pid=2894): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2894)] 16:00:09.294167 run osmo-hlr_10.42.42.2(pid=2894): stdout: | (launched: 2022-12-13_16:00:06.113567) 16:00:09.347156 run osmo-hlr_10.42.42.2(pid=2894): stderr: | [0;m[1;31m20221213160006313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160006313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160006313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160006313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160006313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160006313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160006326 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160006334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160006334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160006334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:09.420271 run osmo-msc_10.42.42.6(pid=2900): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2900)] 16:00:09.470642 run osmo-msc_10.42.42.6(pid=2900): stdout: | (launched: 2022-12-13_16:00:08.241232) 16:00:09.522775 run osmo-msc_10.42.42.6(pid=2900): stderr: | [0;m[38;5;43m20221213160008567 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160008567 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fef86b40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160008567 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160008567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160008567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160008568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160008569 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160008570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160008570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160008570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:00:09.575458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2893): Terminating (SIGTERM) 16:00:09.617789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2896): Terminating (SIGTERM) 16:00:09.660620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2899): Terminating (SIGTERM) 16:00:09.703176 --- ParallelTerminationStrategy: PID 2893 died... 16:00:09.723607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2893): Terminated: ok {rc=0} 16:00:09.770135 --- ParallelTerminationStrategy: PID 2896 died... 16:00:09.789879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2896): Terminated: ok {rc=0} 16:00:09.836134 --- ParallelTerminationStrategy: PID 2899 died... 16:00:09.855941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2899): Terminated: ok {rc=0} 16:00:09.944129 bus /sierra_3: Setting Powered False 16:00:11.042786 bus /sierra_3: Setting Powered False 16:00:12.162008 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 emergency:trx-b200 --------------------------------------------------------------------- 16:00:13.428666 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:00:13.433947 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 16:00:13.471049 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 16:00:13.503010 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 16:00:13.590900 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 16:00:13.628359 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 16:00:13.656847 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 16:00:14.238992 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2391 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 16:00:14.246254 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:14.258552 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 16:00:14.316189 tst emergency_mo_mt_call.py: using LAC 34692 16:00:14.441068 tst emergency_mo_mt_call.py: using RAC 12 16:00:14.569341 tst emergency_mo_mt_call.py: using CellId 34692 16:00:14.698765 tst emergency_mo_mt_call.py: using BVCI 34693 16:00:14.819986 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:14.831288 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:14.842439 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:14.853574 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:14.864851 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:14.876323 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:00:14.999867 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:00:15.121521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:15.633885 run create_hlr_db(pid=3258): Launched 16:00:15.761752 bus /sierra_2: Setting Powered False 16:00:16.858581 run create_hlr_db(pid=3258): Terminated: ok {rc=0} 16:00:17.335341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3260): Launched 16:00:17.647850 run osmo-hlr_10.42.42.2(pid=3261): Launched 16:00:17.765050 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:18.312165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3263): Launched 16:00:18.623015 run osmo-stp_10.42.42.5(pid=3264): Launched 16:00:18.753214 tst emergency_mo_mt_call.py: using MSISDN 8214 16:00:18.923477 run osmo-msc_10.42.42.6: Starting osmo-msc 16:00:19.479731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3266): Launched 16:00:19.790220 run osmo-msc_10.42.42.6(pid=3267): Launched 16:00:19.965311 run osmo-stp_10.42.42.5(pid=3264): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3264)] 16:00:20.095358 run osmo-stp_10.42.42.5(pid=3264): stdout: | (launched: 2022-12-13_16:00:18.564724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:20.225200 run osmo-stp_10.42.42.5(pid=3264): stderr: | [0;m[38;5;43m20221213160018737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160018738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160018738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160018738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160018739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160018739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160018739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:20.352728 run osmo-stp_10.42.42.5(pid=3264): stdout: | (launched: 2022-12-13_16:00:18.564724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:20.474763 run osmo-stp_10.42.42.5(pid=3264): stderr: | [0;m[38;5;43m20221213160018737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160018738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160018738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160018738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160018739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160018739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160018739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:20.620811 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=3264): Process ended prematurely: osmo-stp_10.42.42.5(pid=3264) [trial-2391↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3264)] [trial-2391↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 16:00:20.629224 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 16:00:20.655368 run osmo-hlr_10.42.42.2(pid=3261): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3261)] 16:00:20.703300 run osmo-hlr_10.42.42.2(pid=3261): stdout: | (launched: 2022-12-13_16:00:17.589828) 16:00:20.753078 run osmo-hlr_10.42.42.2(pid=3261): stderr: | [0;m[1;31m20221213160017772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160017773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160017773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160017773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160017773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160017773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160017785 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160017794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160017794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160017794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:20.823196 run osmo-msc_10.42.42.6(pid=3267): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3267)] 16:00:20.870985 run osmo-msc_10.42.42.6(pid=3267): stdout: | (launched: 2022-12-13_16:00:19.731828) 16:00:20.920342 run osmo-msc_10.42.42.6(pid=3267): stderr: | [0;m[38;5;43m20221213160020006 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160020007 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc625ac7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160020007 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160020007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160020007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160020007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160020009 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160020009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160020010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160020010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:00:20.970228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3260): Terminating (SIGTERM) 16:00:21.010257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3263): Terminating (SIGTERM) 16:00:21.050898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3266): Terminating (SIGTERM) 16:00:21.091475 --- ParallelTerminationStrategy: PID 3260 died... 16:00:21.110738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3260): Terminated: ok {rc=0} 16:00:21.155024 --- ParallelTerminationStrategy: PID 3263 died... 16:00:21.173707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3263): Terminated: ok {rc=0} 16:00:21.217706 --- ParallelTerminationStrategy: PID 3266 died... 16:00:21.236730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3266): Terminated: ok {rc=0} 16:00:21.323870 bus /sierra_3: Setting Powered False 16:00:22.424451 bus /sierra_3: Setting Powered False 16:00:23.542399 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 16:00:24.639678 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:24.652851 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 16:00:24.708906 tst emergency_preemptive_call.py: using LAC 34693 16:00:24.840513 tst emergency_preemptive_call.py: using RAC 13 16:00:24.972720 tst emergency_preemptive_call.py: using CellId 34693 16:00:25.101956 tst emergency_preemptive_call.py: using BVCI 34694 16:00:25.227089 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:25.239313 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:25.251485 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:25.263507 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:25.276433 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:00:25.289403 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:00:25.418121 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:00:25.543774 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:00:25.671701 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:00:25.793386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:26.316745 run create_hlr_db(pid=3444): Launched 16:00:26.482478 bus /sierra_2: Setting Powered False 16:00:27.549228 run create_hlr_db(pid=3444): Terminated: ok {rc=0} 16:00:28.023025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3446): Launched 16:00:28.375983 run osmo-hlr_10.42.42.2(pid=3447): Launched 16:00:28.635697 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:29.319836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3450): Launched 16:00:29.655764 run osmo-stp_10.42.42.5(pid=3451): Launched 16:00:29.794520 tst emergency_preemptive_call.py: using MSISDN 8215 16:00:29.965244 run osmo-msc_10.42.42.6: Starting osmo-msc 16:00:30.558289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3453): Launched 16:00:30.901172 run osmo-msc_10.42.42.6(pid=3454): Launched 16:00:31.340883 run osmo-stp_10.42.42.5(pid=3451): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3451)] 16:00:31.654483 run osmo-stp_10.42.42.5(pid=3451): stdout: | (launched: 2022-12-13_16:00:29.594026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:31.834966 run osmo-stp_10.42.42.5(pid=3451): stderr: | [0;m[38;5;43m20221213160029788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160029788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160029789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160029789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160029790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160029790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160029790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:31.967706 run osmo-stp_10.42.42.5(pid=3451): stdout: | (launched: 2022-12-13_16:00:29.594026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:32.093827 run osmo-stp_10.42.42.5(pid=3451): stderr: | [0;m[38;5;43m20221213160029788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160029788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160029789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160029789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160029790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160029790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160029790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:32.244127 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=3451): Process ended prematurely: osmo-stp_10.42.42.5(pid=3451) [trial-2391↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3451)] [trial-2391↪emergency:trx-b200↪emergency_preemptive_call.py:32] 16:00:32.253126 tst emergency_preemptive_call.py:32: Test FAILED (7.6 sec) 16:00:32.280492 run osmo-hlr_10.42.42.2(pid=3447): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3447)] 16:00:32.330235 run osmo-hlr_10.42.42.2(pid=3447): stdout: | (launched: 2022-12-13_16:00:28.312810) 16:00:32.381121 run osmo-hlr_10.42.42.2(pid=3447): stderr: | [0;m[1;31m20221213160028629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160028629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160028629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160028629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160028629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160028629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160028643 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160028658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160028658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160028658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:32.452168 run osmo-msc_10.42.42.6(pid=3454): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3454)] 16:00:32.501761 run osmo-msc_10.42.42.6(pid=3454): stdout: | (launched: 2022-12-13_16:00:30.828652) 16:00:32.552308 run osmo-msc_10.42.42.6(pid=3454): stderr: | [0;m[38;5;43m20221213160031365 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160031367 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba5b717c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160031367 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160031368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160031369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160031370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160031380 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160031383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160031384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160031384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:00:32.603612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3446): Terminating (SIGTERM) 16:00:32.644151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3450): Terminating (SIGTERM) 16:00:32.684924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3453): Terminating (SIGTERM) 16:00:32.725801 --- ParallelTerminationStrategy: PID 3446 died... 16:00:32.745352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3446): Terminated: ok {rc=0} 16:00:32.790359 --- ParallelTerminationStrategy: PID 3450 died... 16:00:32.809419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3450): Terminated: ok {rc=0} 16:00:32.854281 --- ParallelTerminationStrategy: PID 3453 died... 16:00:32.873356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3453): Terminated: ok {rc=0} 16:00:32.960904 bus /sierra_9: Setting Powered False 16:00:34.062676 bus /sierra_9: Setting Powered False 16:00:35.180208 bus /sierra_8: Setting Powered False 16:00:36.281167 bus /sierra_8: Setting Powered False 16:00:37.397771 bus /sierra_3: Setting Powered False 16:00:38.498274 bus /sierra_3: Setting Powered False 16:00:39.619229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-b200 --------------------------------------------------------------------- 16:00:40.902527 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:00:40.906897 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 16:00:40.939942 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 16:00:40.978530 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 16:00:41.065896 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 16:00:41.098878 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 16:00:41.137393 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 16:00:41.728697 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 16:00:41.779922 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:41.790617 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 16:00:41.839529 tst cs_paging_gprs_active.py: using LAC 34694 16:00:41.966127 tst cs_paging_gprs_active.py: using RAC 14 16:00:42.091703 tst cs_paging_gprs_active.py: using CellId 34694 16:00:42.217741 tst cs_paging_gprs_active.py: using BVCI 34695 16:00:42.333509 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:42.344301 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:42.354886 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:42.365441 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:42.376078 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:42.386526 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:42.397570 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:42.407987 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:42.418658 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:00:42.538692 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:00:42.658563 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:00:42.871211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:43.189412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3460): Launched 16:00:43.467730 run iperf3-srv_10.42.42.10(pid=3461): Launched 16:00:43.588523 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:00:43.800564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:44.119850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3462): Launched 16:00:44.399689 run iperf3-srv_10.42.42.10(pid=3463): Launched 16:00:44.520433 tst cs_paging_gprs_active.py:38: start network... 16:00:44.732068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:45.222749 run create_hlr_db(pid=3464): Launched 16:00:45.353909 bus /sierra_2: Setting Powered False 16:00:46.434734 run create_hlr_db(pid=3464): Terminated: ok {rc=0} 16:00:46.915742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3466): Launched 16:00:47.248814 run osmo-hlr_10.42.42.2(pid=3467): Launched 16:00:47.369375 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:47.919188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3469): Launched 16:00:48.238794 run osmo-stp_10.42.42.5(pid=3470): Launched 16:00:48.359225 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:00:48.903661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3472): Launched 16:00:49.026672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:00:49.294892 run patchelf(pid=3473): Launched 16:00:49.473822 run osmo-stp_10.42.42.5(pid=3470): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3470)] 16:00:49.607767 run osmo-stp_10.42.42.5(pid=3470): stdout: | (launched: 2022-12-13_16:00:48.179546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:49.743123 run osmo-stp_10.42.42.5(pid=3470): stderr: | [0;m[38;5;43m20221213160048352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160048352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160048352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160048353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160048353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160048354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160048354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:49.878716 run osmo-stp_10.42.42.5(pid=3470): stdout: | (launched: 2022-12-13_16:00:48.179546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:50.007711 run osmo-stp_10.42.42.5(pid=3470): stderr: | [0;m[38;5;43m20221213160048352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160048352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160048352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160048353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160048353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160048354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160048354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:50.160725 run patchelf(pid=3473): Terminating (SIGINT) 16:00:50.339095 run patchelf(pid=3473): Terminated: ok {rc=0} 16:00:50.467578 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3470): Process ended prematurely: osmo-stp_10.42.42.5(pid=3470) [trial-2391↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3470)] [trial-2391↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 16:00:50.477677 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:00:50.505362 run osmo-hlr_10.42.42.2(pid=3467): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3467)] 16:00:50.553985 run osmo-hlr_10.42.42.2(pid=3467): stdout: | (launched: 2022-12-13_16:00:47.189845) 16:00:50.604070 run osmo-hlr_10.42.42.2(pid=3467): stderr: | [0;m[1;31m20221213160047371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160047371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160047371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160047371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160047371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160047371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160047383 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160047391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160047391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160047391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:50.654211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3460): Terminating (SIGTERM) 16:00:50.694921 run iperf3-srv_10.42.42.10(pid=3461): Terminating (SIGTERM) 16:00:50.735431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3462): Terminating (SIGTERM) 16:00:50.776198 run iperf3-srv_10.42.42.10(pid=3463): Terminating (SIGTERM) 16:00:50.816586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3466): Terminating (SIGTERM) 16:00:50.857740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3469): Terminating (SIGTERM) 16:00:50.898239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3472): Terminating (SIGTERM) 16:00:50.938711 --- ParallelTerminationStrategy: PID 3460 died... 16:00:50.958291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3460): Terminated: ok {rc=0} 16:00:51.002890 --- ParallelTerminationStrategy: PID 3461 died... 16:00:51.021785 run iperf3-srv_10.42.42.10(pid=3461): Terminated {rc=256} 16:00:51.066200 --- ParallelTerminationStrategy: PID 3462 died... 16:00:51.085100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3462): Terminated: ok {rc=0} 16:00:51.129403 --- ParallelTerminationStrategy: PID 3463 died... 16:00:51.148243 run iperf3-srv_10.42.42.10(pid=3463): Terminated {rc=256} 16:00:51.192581 --- ParallelTerminationStrategy: PID 3466 died... 16:00:51.211584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3466): Terminated: ok {rc=0} 16:00:51.255974 --- ParallelTerminationStrategy: PID 3469 died... 16:00:51.274909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3469): Terminated: ok {rc=0} 16:00:51.319237 --- ParallelTerminationStrategy: PID 3472 died... 16:00:51.338176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3472): Terminated: ok {rc=0} 16:00:51.424809 bus /gobi_0: Setting Powered False 16:00:52.525905 bus /gobi_0: Setting Powered False 16:00:53.639859 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200 iperf3.py ---------------------------------------------- 16:00:54.791893 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:54.804312 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 16:00:54.858512 tst iperf3.py: using LAC 34695 16:00:54.990836 tst iperf3.py: using RAC 15 16:00:55.123911 tst iperf3.py: using CellId 34695 16:00:55.258247 tst iperf3.py: using BVCI 34696 16:00:55.382646 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:55.394027 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:55.404926 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:55.416007 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:55.427322 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:55.438608 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:55.450181 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:55.461571 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:55.472875 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:00:55.591991 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:00:55.803561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:56.120681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3475): Launched 16:00:56.398844 run iperf3-srv_10.42.42.10(pid=3476): Launched 16:00:56.519103 tst iperf3.py:8: start network... 16:00:56.729779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:57.216430 run create_hlr_db(pid=3477): Launched 16:00:57.346382 bus /gobi_6: Setting Powered False 16:00:58.410633 run create_hlr_db(pid=3477): Terminated: ok {rc=0} 16:00:58.877834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3479): Launched 16:00:59.215330 run osmo-hlr_10.42.42.2(pid=3480): Launched 16:00:59.346436 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:59.925943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3482): Launched 16:01:00.265643 run osmo-stp_10.42.42.5(pid=3483): Launched 16:01:00.397347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:00.997978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3485): Launched 16:01:01.143553 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:01.436477 run patchelf(pid=3486): Launched 16:01:01.667143 run osmo-stp_10.42.42.5(pid=3483): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3483)] 16:01:01.803859 run osmo-stp_10.42.42.5(pid=3483): stdout: | (launched: 2022-12-13_16:01:00.202879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:01.941712 run osmo-stp_10.42.42.5(pid=3483): stderr: | [0;m[38;5;43m20221213160100400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160100400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160100400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160100401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160100403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160100403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160100403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:02.155548 run osmo-stp_10.42.42.5(pid=3483): stdout: | (launched: 2022-12-13_16:01:00.202879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:02.287419 run osmo-stp_10.42.42.5(pid=3483): stderr: | [0;m[38;5;43m20221213160100400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160100400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160100400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160100401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160100403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160100403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160100403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:02.440761 run patchelf(pid=3486): Terminating (SIGINT) 16:01:02.618386 run patchelf(pid=3486): Terminated: ok {rc=0} 16:01:02.746741 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3483): Process ended prematurely: osmo-stp_10.42.42.5(pid=3483) [trial-2391↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3483)] [trial-2391↪gprs:trx-b200↪iperf3.py:8] 16:01:02.756510 tst iperf3.py:8: Test FAILED (8.0 sec) 16:01:02.784225 run osmo-hlr_10.42.42.2(pid=3480): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3480)] 16:01:02.833737 run osmo-hlr_10.42.42.2(pid=3480): stdout: | (launched: 2022-12-13_16:00:59.153034) 16:01:02.884567 run osmo-hlr_10.42.42.2(pid=3480): stderr: | [0;m[1;31m20221213160059355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160059355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160059355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160059355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160059355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160059355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160059367 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160059375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160059375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160059375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:02.935857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3475): Terminating (SIGTERM) 16:01:02.977165 run iperf3-srv_10.42.42.10(pid=3476): Terminating (SIGTERM) 16:01:03.018139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3479): Terminating (SIGTERM) 16:01:03.059126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3482): Terminating (SIGTERM) 16:01:03.100173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3485): Terminating (SIGTERM) 16:01:03.141570 --- ParallelTerminationStrategy: PID 3475 died... 16:01:03.161706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3475): Terminated: ok {rc=0} 16:01:03.207008 --- ParallelTerminationStrategy: PID 3476 died... 16:01:03.226510 run iperf3-srv_10.42.42.10(pid=3476): Terminated {rc=256} 16:01:03.271348 --- ParallelTerminationStrategy: PID 3479 died... 16:01:03.290807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3479): Terminated: ok {rc=0} 16:01:03.335788 --- ParallelTerminationStrategy: PID 3482 died... 16:01:03.355409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3482): Terminated: ok {rc=0} 16:01:03.400313 --- ParallelTerminationStrategy: PID 3485 died... 16:01:03.419862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3485): Terminated: ok {rc=0} 16:01:03.508410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 16:01:04.658092 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:04.669832 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 16:01:04.719576 tst iperf3m4.py: using LAC 34696 16:01:04.844695 tst iperf3m4.py: using RAC 16 16:01:04.971330 tst iperf3m4.py: using CellId 34696 16:01:05.095815 tst iperf3m4.py: using BVCI 34697 16:01:05.212190 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:05.223106 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:05.233695 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:05.244185 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:05.254659 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:05.265372 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:05.276200 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:05.286866 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:05.297720 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:01:05.416132 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:01:05.540123 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:01:05.659701 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:01:05.778690 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:01:05.990089 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:06.307944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3487): Launched 16:01:06.588086 run iperf3-srv_10.42.42.10(pid=3488): Launched 16:01:06.706890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:01:06.917603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:07.235911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3489): Launched 16:01:07.514982 run iperf3-srv_10.42.42.10(pid=3490): Launched 16:01:07.634489 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:01:07.845794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:08.164204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3491): Launched 16:01:08.440211 run iperf3-srv_10.42.42.10(pid=3492): Launched 16:01:08.561191 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:01:08.771380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:09.088936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3493): Launched 16:01:09.364872 run iperf3-srv_10.42.42.10(pid=3494): Launched 16:01:09.483155 tst iperf3m4.py:8: start network... 16:01:09.693992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:10.182222 run create_hlr_db(pid=3495): Launched 16:01:10.312023 bus /gobi_6: Setting Powered False 16:01:11.373823 run create_hlr_db(pid=3495): Terminated: ok {rc=0} 16:01:11.824649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3497): Launched 16:01:12.142318 run osmo-hlr_10.42.42.2(pid=3498): Launched 16:01:12.263398 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:12.823543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3500): Launched 16:01:13.141217 run osmo-stp_10.42.42.5(pid=3501): Launched 16:01:13.260789 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:13.803532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3503): Launched 16:01:13.926277 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:14.194322 run patchelf(pid=3504): Launched 16:01:14.370399 run osmo-stp_10.42.42.5(pid=3501): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3501)] 16:01:14.503422 run osmo-stp_10.42.42.5(pid=3501): stdout: | (launched: 2022-12-13_16:01:13.081995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:14.638698 run osmo-stp_10.42.42.5(pid=3501): stderr: | [0;m[38;5;43m20221213160113255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160113255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160113256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160113256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160113257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160113257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160113257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:14.773754 run osmo-stp_10.42.42.5(pid=3501): stdout: | (launched: 2022-12-13_16:01:13.081995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:14.902580 run osmo-stp_10.42.42.5(pid=3501): stderr: | [0;m[38;5;43m20221213160113255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160113255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160113256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160113256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160113257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160113257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160113257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:15.055386 run patchelf(pid=3504): Terminating (SIGINT) 16:01:15.233201 run patchelf(pid=3504): Terminated: ok {rc=0} 16:01:15.361734 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3501): Process ended prematurely: osmo-stp_10.42.42.5(pid=3501) [trial-2391↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3501)] [trial-2391↪gprs:trx-b200↪iperf3m4.py:8] 16:01:15.371329 tst iperf3m4.py:8: Test FAILED (10.8 sec) 16:01:15.399115 run osmo-hlr_10.42.42.2(pid=3498): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3498)] 16:01:15.447304 run osmo-hlr_10.42.42.2(pid=3498): stdout: | (launched: 2022-12-13_16:01:12.083071) 16:01:15.497189 run osmo-hlr_10.42.42.2(pid=3498): stderr: | [0;m[1;31m20221213160112260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160112260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160112260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160112260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160112261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160112261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160112274 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160112282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160112282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160112282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:15.547429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3487): Terminating (SIGTERM) 16:01:15.587636 run iperf3-srv_10.42.42.10(pid=3488): Terminating (SIGTERM) 16:01:15.627525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3489): Terminating (SIGTERM) 16:01:15.668286 run iperf3-srv_10.42.42.10(pid=3490): Terminating (SIGTERM) 16:01:15.708883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3491): Terminating (SIGTERM) 16:01:15.749331 run iperf3-srv_10.42.42.10(pid=3492): Terminating (SIGTERM) 16:01:15.789551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3493): Terminating (SIGTERM) 16:01:15.829787 run iperf3-srv_10.42.42.10(pid=3494): Terminating (SIGTERM) 16:01:15.896509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3497): Terminating (SIGTERM) 16:01:15.938521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3500): Terminating (SIGTERM) 16:01:15.979971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3503): Terminating (SIGTERM) 16:01:16.021737 --- ParallelTerminationStrategy: PID 3487 died... 16:01:16.041497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3487): Terminated: ok {rc=0} 16:01:16.087615 --- ParallelTerminationStrategy: PID 3488 died... 16:01:16.107783 run iperf3-srv_10.42.42.10(pid=3488): Terminated {rc=256} 16:01:16.153619 --- ParallelTerminationStrategy: PID 3489 died... 16:01:16.173734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3489): Terminated: ok {rc=0} 16:01:16.218994 --- ParallelTerminationStrategy: PID 3490 died... 16:01:16.238809 run iperf3-srv_10.42.42.10(pid=3490): Terminated {rc=256} 16:01:16.284118 --- ParallelTerminationStrategy: PID 3491 died... 16:01:16.303627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3491): Terminated: ok {rc=0} 16:01:16.348715 --- ParallelTerminationStrategy: PID 3492 died... 16:01:16.368253 run iperf3-srv_10.42.42.10(pid=3492): Terminated {rc=256} 16:01:16.413217 --- ParallelTerminationStrategy: PID 3493 died... 16:01:16.432475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3493): Terminated: ok {rc=0} 16:01:16.477582 --- ParallelTerminationStrategy: PID 3494 died... 16:01:16.497025 run iperf3-srv_10.42.42.10(pid=3494): Terminated {rc=256} 16:01:16.541994 --- ParallelTerminationStrategy: PID 3497 died... 16:01:16.561600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3497): Terminated: ok {rc=0} 16:01:16.606888 --- ParallelTerminationStrategy: PID 3500 died... 16:01:16.626349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3500): Terminated: ok {rc=0} 16:01:16.671945 --- ParallelTerminationStrategy: PID 3503 died... 16:01:16.691537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3503): Terminated: ok {rc=0} 16:01:16.780660 bus /gobi_4: Setting Powered False 16:01:17.883589 bus /gobi_4: Setting Powered False 16:01:19.002199 bus /gobi_1: Setting Powered False 16:01:20.101783 bus /gobi_1: Setting Powered False 16:01:21.218608 bus /gobi_0: Setting Powered False 16:01:22.315621 bus /gobi_0: Setting Powered False 16:01:23.433028 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200 ping.py ---------------------------------------------- 16:01:24.537203 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:24.548778 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 16:01:24.598657 tst ping.py: using LAC 34697 16:01:24.721983 tst ping.py: using RAC 17 16:01:24.845429 tst ping.py: using CellId 34697 16:01:24.969090 tst ping.py: using BVCI 34698 16:01:25.082055 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:25.092694 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:25.103372 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:25.113951 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:25.124353 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:25.135035 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:25.145867 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:25.156460 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:01:25.275727 tst ping.py:19: start network... 16:01:25.482475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:25.961213 run create_hlr_db(pid=3505): Launched 16:01:26.089787 bus /gobi_6: Setting Powered False 16:01:27.150809 run create_hlr_db(pid=3505): Terminated: ok {rc=0} 16:01:27.603367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3507): Launched 16:01:27.935931 run osmo-hlr_10.42.42.2(pid=3508): Launched 16:01:28.064436 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:28.640661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3510): Launched 16:01:28.974052 run osmo-stp_10.42.42.5(pid=3511): Launched 16:01:29.100372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:29.671899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3513): Launched 16:01:29.801741 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:30.082982 run patchelf(pid=3514): Launched 16:01:30.268118 run osmo-stp_10.42.42.5(pid=3511): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3511)] 16:01:30.409352 run osmo-stp_10.42.42.5(pid=3511): stdout: | (launched: 2022-12-13_16:01:28.912279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:30.551889 run osmo-stp_10.42.42.5(pid=3511): stderr: | [0;m[38;5;43m20221213160129105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160129106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160129106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160129106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160129107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160129107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160129107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:30.694273 run osmo-stp_10.42.42.5(pid=3511): stdout: | (launched: 2022-12-13_16:01:28.912279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:30.833477 run osmo-stp_10.42.42.5(pid=3511): stderr: | [0;m[38;5;43m20221213160129105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160129106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160129106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160129106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160129107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160129107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160129107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:31.009567 run patchelf(pid=3514): Terminating (SIGINT) 16:01:31.198857 run patchelf(pid=3514): Terminated: ok {rc=0} 16:01:31.336842 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3511): Process ended prematurely: osmo-stp_10.42.42.5(pid=3511) [trial-2391↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3511)] [trial-2391↪gprs:trx-b200↪ping.py:22] 16:01:31.347679 tst ping.py:22: Test FAILED (6.8 sec) 16:01:31.378030 run osmo-hlr_10.42.42.2(pid=3508): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3508)] 16:01:31.434039 run osmo-hlr_10.42.42.2(pid=3508): stdout: | (launched: 2022-12-13_16:01:27.874369) 16:01:31.489352 run osmo-hlr_10.42.42.2(pid=3508): stderr: | [0;m[1;31m20221213160128075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160128075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160128075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160128075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160128075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160128075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160128088 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160128098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160128098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160128099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:31.545339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3507): Terminating (SIGTERM) 16:01:31.589433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3510): Terminating (SIGTERM) 16:01:31.634659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3513): Terminating (SIGTERM) 16:01:31.679823 --- ParallelTerminationStrategy: PID 3507 died... 16:01:31.702065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3507): Terminated: ok {rc=0} 16:01:31.751418 --- ParallelTerminationStrategy: PID 3510 died... 16:01:31.773327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3510): Terminated: ok {rc=0} 16:01:31.822900 --- ParallelTerminationStrategy: PID 3513 died... 16:01:31.845029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3513): Terminated: ok {rc=0} 16:01:31.941811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 16:01:33.045139 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:33.057738 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 16:01:33.110585 tst ping_idle_ping.py: using LAC 34698 16:01:33.239624 tst ping_idle_ping.py: using RAC 18 16:01:33.367987 tst ping_idle_ping.py: using CellId 34698 16:01:33.496451 tst ping_idle_ping.py: using BVCI 34699 16:01:33.616790 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:33.627972 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:33.639128 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:33.650260 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:33.661703 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:33.672859 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:33.684406 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:01:33.695784 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:01:33.817159 tst ping_idle_ping.py:24: start network... 16:01:34.040415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:34.555252 run create_hlr_db(pid=3515): Launched 16:01:34.683423 bus /gobi_6: Setting Powered False 16:01:35.748766 run create_hlr_db(pid=3515): Terminated: ok {rc=0} 16:01:36.193278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3517): Launched 16:01:36.506707 run osmo-hlr_10.42.42.2(pid=3518): Launched 16:01:36.627871 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:37.163690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3520): Launched 16:01:37.476837 run osmo-stp_10.42.42.5(pid=3521): Launched 16:01:37.597896 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:38.135605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3523): Launched 16:01:38.256182 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:38.519070 run patchelf(pid=3524): Launched 16:01:38.693779 run osmo-stp_10.42.42.5(pid=3521): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3521)] 16:01:38.824832 run osmo-stp_10.42.42.5(pid=3521): stdout: | (launched: 2022-12-13_16:01:37.418155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:38.958003 run osmo-stp_10.42.42.5(pid=3521): stderr: | [0;m[38;5;43m20221213160137592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160137592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160137593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160137593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160137593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160137593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160137594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:39.091127 run osmo-stp_10.42.42.5(pid=3521): stdout: | (launched: 2022-12-13_16:01:37.418155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:39.217647 run osmo-stp_10.42.42.5(pid=3521): stderr: | [0;m[38;5;43m20221213160137592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160137592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160137593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160137593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160137593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160137593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160137594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:39.367806 run patchelf(pid=3524): Terminating (SIGINT) 16:01:39.542481 run patchelf(pid=3524): Terminated: ok {rc=0} 16:01:39.668223 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3521): Process ended prematurely: osmo-stp_10.42.42.5(pid=3521) [trial-2391↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3521)] [trial-2391↪gprs:trx-b200↪ping_idle_ping.py:27] 16:01:39.677388 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:01:39.704932 run osmo-hlr_10.42.42.2(pid=3518): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3518)] 16:01:39.753574 run osmo-hlr_10.42.42.2(pid=3518): stdout: | (launched: 2022-12-13_16:01:36.448331) 16:01:39.803931 run osmo-hlr_10.42.42.2(pid=3518): stderr: | [0;m[1;31m20221213160136628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160136629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160136629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160136629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160136629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160136629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160136641 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160136651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160136651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160136651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:39.855045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3517): Terminating (SIGTERM) 16:01:39.895994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3520): Terminating (SIGTERM) 16:01:39.936642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3523): Terminating (SIGTERM) 16:01:39.978771 --- ParallelTerminationStrategy: PID 3517 died... 16:01:39.998197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3517): Terminated: ok {rc=0} 16:01:40.043069 --- ParallelTerminationStrategy: PID 3520 died... 16:01:40.062085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3520): Terminated: ok {rc=0} 16:01:40.106479 --- ParallelTerminationStrategy: PID 3523 died... 16:01:40.125507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3523): Terminated: ok {rc=0} 16:01:40.212772 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 16:01:41.528859 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:01:41.535090 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:01:41.569722 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:01:41.611620 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:01:41.703950 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:01:41.739224 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:01:41.779598 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:01:42.373476 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:01:42.428616 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:42.439994 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:01:42.493438 tst cs_paging_gprs_active.py: using LAC 34699 16:01:42.618826 tst cs_paging_gprs_active.py: using RAC 19 16:01:42.744803 tst cs_paging_gprs_active.py: using CellId 34699 16:01:42.869876 tst cs_paging_gprs_active.py: using BVCI 34700 16:01:42.984255 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:42.995240 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:43.006046 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:43.016689 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:43.027410 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:43.038464 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:43.049740 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:43.060710 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:43.071496 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:01:43.196116 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:01:43.316725 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:01:43.529808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:43.848554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3528): Launched 16:01:44.127709 run iperf3-srv_10.42.42.10(pid=3529): Launched 16:01:44.248365 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:01:44.460423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:44.779489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3530): Launched 16:01:45.056790 run iperf3-srv_10.42.42.10(pid=3531): Launched 16:01:45.175376 tst cs_paging_gprs_active.py:38: start network... 16:01:45.386296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:45.879432 run create_hlr_db(pid=3532): Launched 16:01:46.025357 bus /gobi_6: Setting Powered False 16:01:47.089915 run create_hlr_db(pid=3532): Terminated: ok {rc=0} 16:01:47.564624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3534): Launched 16:01:47.903966 run osmo-hlr_10.42.42.2(pid=3535): Launched 16:01:48.035289 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:48.617465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3537): Launched 16:01:48.958165 run osmo-stp_10.42.42.5(pid=3538): Launched 16:01:49.089636 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:49.673092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3540): Launched 16:01:49.803826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:50.090123 run patchelf(pid=3541): Launched 16:01:50.280352 run osmo-stp_10.42.42.5(pid=3538): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3538)] 16:01:50.424268 run osmo-stp_10.42.42.5(pid=3538): stdout: | (launched: 2022-12-13_16:01:48.895402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:50.568654 run osmo-stp_10.42.42.5(pid=3538): stderr: | [0;m[38;5;43m20221213160149091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160149091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160149092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160149092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160149092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160149093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160149093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:50.712891 run osmo-stp_10.42.42.5(pid=3538): stdout: | (launched: 2022-12-13_16:01:48.895402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:50.850547 run osmo-stp_10.42.42.5(pid=3538): stderr: | [0;m[38;5;43m20221213160149091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160149091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160149092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160149092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160149092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160149093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160149093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:51.013509 run patchelf(pid=3541): Terminating (SIGINT) 16:01:51.203402 run patchelf(pid=3541): Terminated: ok {rc=0} 16:01:51.340270 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3538): Process ended prematurely: osmo-stp_10.42.42.5(pid=3538) [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3538)] [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:01:51.350713 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:01:51.379767 run osmo-hlr_10.42.42.2(pid=3535): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3535)] 16:01:51.431099 run osmo-hlr_10.42.42.2(pid=3535): stdout: | (launched: 2022-12-13_16:01:47.841369) 16:01:51.483880 run osmo-hlr_10.42.42.2(pid=3535): stderr: | [0;m[1;31m20221213160148044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160148044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160148044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160148044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160148044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160148044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160148056 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160148065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160148065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160148065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:51.537355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3528): Terminating (SIGTERM) 16:01:51.580178 run iperf3-srv_10.42.42.10(pid=3529): Terminating (SIGTERM) 16:01:51.623088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3530): Terminating (SIGTERM) 16:01:51.665964 run iperf3-srv_10.42.42.10(pid=3531): Terminating (SIGTERM) 16:01:51.708791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3534): Terminating (SIGTERM) 16:01:51.751376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3537): Terminating (SIGTERM) 16:01:51.794514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3540): Terminating (SIGTERM) 16:01:51.837745 --- ParallelTerminationStrategy: PID 3528 died... 16:01:51.858196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3528): Terminated: ok {rc=0} 16:01:51.904835 --- ParallelTerminationStrategy: PID 3529 died... 16:01:51.924728 run iperf3-srv_10.42.42.10(pid=3529): Terminated {rc=256} 16:01:51.971277 --- ParallelTerminationStrategy: PID 3530 died... 16:01:51.991270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3530): Terminated: ok {rc=0} 16:01:52.037667 --- ParallelTerminationStrategy: PID 3531 died... 16:01:52.057581 run iperf3-srv_10.42.42.10(pid=3531): Terminated {rc=256} 16:01:52.103979 --- ParallelTerminationStrategy: PID 3534 died... 16:01:52.123999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3534): Terminated: ok {rc=0} 16:01:52.170551 --- ParallelTerminationStrategy: PID 3537 died... 16:01:52.190595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3537): Terminated: ok {rc=0} 16:01:52.237251 --- ParallelTerminationStrategy: PID 3540 died... 16:01:52.257366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3540): Terminated: ok {rc=0} 16:01:52.346660 bus /gobi_0: Setting Powered False 16:01:53.443406 bus /gobi_0: Setting Powered False 16:01:54.558352 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:01:55.711044 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:55.723359 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:01:55.784137 tst iperf3.py: using LAC 34700 16:01:55.915063 tst iperf3.py: using RAC 20 16:01:56.040457 tst iperf3.py: using CellId 34700 16:01:56.164047 tst iperf3.py: using BVCI 34701 16:01:56.280176 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:56.291372 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:56.302363 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:56.313290 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:56.324070 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:56.334912 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:56.345972 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:56.356569 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:56.367789 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:01:56.490929 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:01:56.718960 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:57.058351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3542): Launched 16:01:57.354382 run iperf3-srv_10.42.42.10(pid=3543): Launched 16:01:57.483281 tst iperf3.py:8: start network... 16:01:57.710394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:58.232909 run create_hlr_db(pid=3544): Launched 16:01:58.362629 bus /gobi_6: Setting Powered False 16:01:59.428817 run create_hlr_db(pid=3544): Terminated: ok {rc=0} 16:01:59.896233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3546): Launched 16:02:00.235755 run osmo-hlr_10.42.42.2(pid=3547): Launched 16:02:00.367195 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:00.961664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3549): Launched 16:02:01.321714 run osmo-stp_10.42.42.5(pid=3550): Launched 16:02:01.658695 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:02.238229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3552): Launched 16:02:02.379441 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:02.666643 run patchelf(pid=3553): Launched 16:02:02.856647 run osmo-stp_10.42.42.5(pid=3550): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3550)] 16:02:02.999400 run osmo-stp_10.42.42.5(pid=3550): stdout: | (launched: 2022-12-13_16:02:01.255794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:03.144229 run osmo-stp_10.42.42.5(pid=3550): stderr: | [0;m[38;5;43m20221213160201477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160201478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160201478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160201478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160201479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160201479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160201479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:03.289084 run osmo-stp_10.42.42.5(pid=3550): stdout: | (launched: 2022-12-13_16:02:01.255794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:03.427423 run osmo-stp_10.42.42.5(pid=3550): stderr: | [0;m[38;5;43m20221213160201477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160201478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160201478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160201478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160201479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160201479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160201479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:03.591087 run patchelf(pid=3553): Terminating (SIGINT) 16:02:03.779846 run patchelf(pid=3553): Terminated: ok {rc=0} 16:02:03.915942 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3550): Process ended prematurely: osmo-stp_10.42.42.5(pid=3550) [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3550)] [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 16:02:03.926477 tst iperf3.py:8: Test FAILED (8.3 sec) 16:02:03.955450 run osmo-hlr_10.42.42.2(pid=3547): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3547)] 16:02:04.006472 run osmo-hlr_10.42.42.2(pid=3547): stdout: | (launched: 2022-12-13_16:02:00.173477) 16:02:04.059808 run osmo-hlr_10.42.42.2(pid=3547): stderr: | [0;m[1;31m20221213160200374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160200374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160200375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160200375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160200375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160200375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160200391 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160200402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160200402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160200402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:04.113369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3542): Terminating (SIGTERM) 16:02:04.155565 run iperf3-srv_10.42.42.10(pid=3543): Terminating (SIGTERM) 16:02:04.198406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3546): Terminating (SIGTERM) 16:02:04.241009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3549): Terminating (SIGTERM) 16:02:04.284305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3552): Terminating (SIGTERM) 16:02:04.327542 --- ParallelTerminationStrategy: PID 3542 died... 16:02:04.348270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3542): Terminated: ok {rc=0} 16:02:04.395849 --- ParallelTerminationStrategy: PID 3543 died... 16:02:04.416144 run iperf3-srv_10.42.42.10(pid=3543): Terminated {rc=256} 16:02:04.462770 --- ParallelTerminationStrategy: PID 3546 died... 16:02:04.482972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3546): Terminated: ok {rc=0} 16:02:04.529692 --- ParallelTerminationStrategy: PID 3549 died... 16:02:04.549745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3549): Terminated: ok {rc=0} 16:02:04.596482 --- ParallelTerminationStrategy: PID 3552 died... 16:02:04.616715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3552): Terminated: ok {rc=0} 16:02:04.706672 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:02:05.861418 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:05.873645 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:02:05.928310 tst iperf3m4.py: using LAC 34701 16:02:06.061161 tst iperf3m4.py: using RAC 21 16:02:06.192729 tst iperf3m4.py: using CellId 34701 16:02:06.325758 tst iperf3m4.py: using BVCI 34702 16:02:06.441400 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:06.452472 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:06.463466 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:06.474512 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:06.485565 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:06.496590 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:06.507827 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:06.518545 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:06.529674 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:02:06.653733 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:02:06.776629 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:02:06.899510 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:02:07.023217 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:02:07.251558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:07.591531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3554): Launched 16:02:07.887145 run iperf3-srv_10.42.42.10(pid=3555): Launched 16:02:08.015674 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:02:08.243528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:08.583948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3556): Launched 16:02:08.878533 run iperf3-srv_10.42.42.10(pid=3557): Launched 16:02:09.005350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:02:09.231938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:09.571003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3558): Launched 16:02:09.850644 run iperf3-srv_10.42.42.10(pid=3559): Launched 16:02:09.971130 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:02:10.182934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:10.500196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3560): Launched 16:02:10.778290 run iperf3-srv_10.42.42.10(pid=3561): Launched 16:02:10.898197 tst iperf3m4.py:8: start network... 16:02:11.108520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:11.598257 run create_hlr_db(pid=3562): Launched 16:02:11.728797 bus /gobi_6: Setting Powered False 16:02:12.791657 run create_hlr_db(pid=3562): Terminated: ok {rc=0} 16:02:13.229647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3564): Launched 16:02:13.548739 run osmo-hlr_10.42.42.2(pid=3565): Launched 16:02:13.670799 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:14.215021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3567): Launched 16:02:14.533609 run osmo-stp_10.42.42.5(pid=3568): Launched 16:02:14.653365 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:15.196711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3570): Launched 16:02:15.319724 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:15.587688 run patchelf(pid=3571): Launched 16:02:15.765725 run osmo-stp_10.42.42.5(pid=3568): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3568)] 16:02:15.921902 run osmo-stp_10.42.42.5(pid=3568): stdout: | (launched: 2022-12-13_16:02:14.474380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:16.060077 run osmo-stp_10.42.42.5(pid=3568): stderr: | [0;m[38;5;43m20221213160214646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160214646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160214647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160214647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160214647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160214648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160214648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:16.199082 run osmo-stp_10.42.42.5(pid=3568): stdout: | (launched: 2022-12-13_16:02:14.474380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:16.330622 run osmo-stp_10.42.42.5(pid=3568): stderr: | [0;m[38;5;43m20221213160214646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160214646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160214647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160214647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160214647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160214648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160214648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:16.486559 run patchelf(pid=3571): Terminating (SIGINT) 16:02:16.666883 run patchelf(pid=3571): Terminated: ok {rc=0} 16:02:16.797339 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3568): Process ended prematurely: osmo-stp_10.42.42.5(pid=3568) [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3568)] [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 16:02:16.808042 tst iperf3m4.py:8: Test FAILED (11.0 sec) 16:02:16.837231 run osmo-hlr_10.42.42.2(pid=3565): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3565)] 16:02:16.886679 run osmo-hlr_10.42.42.2(pid=3565): stdout: | (launched: 2022-12-13_16:02:13.489555) 16:02:16.937799 run osmo-hlr_10.42.42.2(pid=3565): stderr: | [0;m[1;31m20221213160213669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160213669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160213669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160213669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160213669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160213669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160213681 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160213689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160213689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160213689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:16.988891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3554): Terminating (SIGTERM) 16:02:17.030788 run iperf3-srv_10.42.42.10(pid=3555): Terminating (SIGTERM) 16:02:17.074749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3556): Terminating (SIGTERM) 16:02:17.117259 run iperf3-srv_10.42.42.10(pid=3557): Terminating (SIGTERM) 16:02:17.161384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3558): Terminating (SIGTERM) 16:02:17.203557 run iperf3-srv_10.42.42.10(pid=3559): Terminating (SIGTERM) 16:02:17.244819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3560): Terminating (SIGTERM) 16:02:17.285641 run iperf3-srv_10.42.42.10(pid=3561): Terminating (SIGTERM) 16:02:17.326134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3564): Terminating (SIGTERM) 16:02:17.366796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3567): Terminating (SIGTERM) 16:02:17.407127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3570): Terminating (SIGTERM) 16:02:17.447576 --- ParallelTerminationStrategy: PID 3554 died... 16:02:17.466809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3554): Terminated: ok {rc=0} 16:02:17.511157 --- ParallelTerminationStrategy: PID 3555 died... 16:02:17.529814 run iperf3-srv_10.42.42.10(pid=3555): Terminated {rc=256} 16:02:17.573867 --- ParallelTerminationStrategy: PID 3556 died... 16:02:17.592536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3556): Terminated: ok {rc=0} 16:02:17.636635 --- ParallelTerminationStrategy: PID 3557 died... 16:02:17.655401 run iperf3-srv_10.42.42.10(pid=3557): Terminated {rc=256} 16:02:17.699579 --- ParallelTerminationStrategy: PID 3558 died... 16:02:17.718342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3558): Terminated: ok {rc=0} 16:02:17.762412 --- ParallelTerminationStrategy: PID 3559 died... 16:02:17.780902 run iperf3-srv_10.42.42.10(pid=3559): Terminated {rc=256} 16:02:17.825071 --- ParallelTerminationStrategy: PID 3560 died... 16:02:17.843711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3560): Terminated: ok {rc=0} 16:02:17.887674 --- ParallelTerminationStrategy: PID 3561 died... 16:02:17.906395 run iperf3-srv_10.42.42.10(pid=3561): Terminated {rc=256} 16:02:17.950397 --- ParallelTerminationStrategy: PID 3564 died... 16:02:17.969099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3564): Terminated: ok {rc=0} 16:02:18.013242 --- ParallelTerminationStrategy: PID 3567 died... 16:02:18.031945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3567): Terminated: ok {rc=0} 16:02:18.076230 --- ParallelTerminationStrategy: PID 3570 died... 16:02:18.095143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3570): Terminated: ok {rc=0} 16:02:18.181688 bus /gobi_4: Setting Powered False 16:02:19.283815 bus /gobi_4: Setting Powered False 16:02:20.399462 bus /gobi_1: Setting Powered False 16:02:21.495351 bus /gobi_1: Setting Powered False 16:02:22.610059 bus /gobi_0: Setting Powered False 16:02:23.708012 bus /gobi_0: Setting Powered False 16:02:24.826504 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 16:02:25.927403 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:25.939306 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:02:25.990721 tst ping.py: using LAC 34702 16:02:26.122935 tst ping.py: using RAC 22 16:02:26.254292 tst ping.py: using CellId 34702 16:02:26.388351 tst ping.py: using BVCI 34703 16:02:26.510460 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:26.522281 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:26.533812 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:26.545400 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:26.557023 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:26.568757 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:26.580681 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:26.592023 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:02:26.712458 tst ping.py:19: start network... 16:02:26.919186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:27.396909 run create_hlr_db(pid=3572): Launched 16:02:27.523971 bus /gobi_6: Setting Powered False 16:02:28.586031 run create_hlr_db(pid=3572): Terminated: ok {rc=0} 16:02:29.039671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3574): Launched 16:02:29.374316 run osmo-hlr_10.42.42.2(pid=3575): Launched 16:02:29.503215 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:30.082064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3577): Launched 16:02:30.416826 run osmo-stp_10.42.42.5(pid=3578): Launched 16:02:30.545797 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:31.116647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3580): Launched 16:02:31.256617 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:31.544415 run patchelf(pid=3581): Launched 16:02:31.787492 run osmo-stp_10.42.42.5(pid=3578): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3578)] 16:02:31.967634 run osmo-stp_10.42.42.5(pid=3578): stdout: | (launched: 2022-12-13_16:02:30.354670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:32.151649 run osmo-stp_10.42.42.5(pid=3578): stderr: | [0;m[38;5;43m20221213160230549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160230549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160230549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160230549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160230550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160230550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160230550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:32.313535 run osmo-stp_10.42.42.5(pid=3578): stdout: | (launched: 2022-12-13_16:02:30.354670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:32.450472 run osmo-stp_10.42.42.5(pid=3578): stderr: | [0;m[38;5;43m20221213160230549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160230549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160230549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160230549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160230550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160230550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160230550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:32.611282 run patchelf(pid=3581): Terminating (SIGINT) 16:02:32.797255 run patchelf(pid=3581): Terminated: ok {rc=0} 16:02:32.931004 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3578): Process ended prematurely: osmo-stp_10.42.42.5(pid=3578) [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3578)] [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 16:02:32.940868 tst ping.py:22: Test FAILED (7.0 sec) 16:02:32.969513 run osmo-hlr_10.42.42.2(pid=3575): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3575)] 16:02:33.020783 run osmo-hlr_10.42.42.2(pid=3575): stdout: | (launched: 2022-12-13_16:02:29.312470) 16:02:33.073754 run osmo-hlr_10.42.42.2(pid=3575): stderr: | [0;m[1;31m20221213160229511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160229511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160229511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160229511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160229511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160229511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160229524 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160229535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160229535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160229535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:33.127498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3574): Terminating (SIGTERM) 16:02:33.170378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3577): Terminating (SIGTERM) 16:02:33.213489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3580): Terminating (SIGTERM) 16:02:33.256742 --- ParallelTerminationStrategy: PID 3574 died... 16:02:33.277133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3574): Terminated: ok {rc=0} 16:02:33.324446 --- ParallelTerminationStrategy: PID 3577 died... 16:02:33.344658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3577): Terminated: ok {rc=0} 16:02:33.391909 --- ParallelTerminationStrategy: PID 3580 died... 16:02:33.411960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3580): Terminated: ok {rc=0} 16:02:33.502636 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:02:34.591286 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:34.603528 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:02:34.656789 tst ping_idle_ping.py: using LAC 34703 16:02:34.787502 tst ping_idle_ping.py: using RAC 23 16:02:34.909450 tst ping_idle_ping.py: using CellId 34703 16:02:35.033271 tst ping_idle_ping.py: using BVCI 34704 16:02:35.145598 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:35.156736 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:35.167803 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:35.178877 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:35.190120 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:35.201166 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:35.212527 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:02:35.223570 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:02:35.343655 tst ping_idle_ping.py:24: start network... 16:02:35.568197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:36.084420 run create_hlr_db(pid=3582): Launched 16:02:36.212432 bus /gobi_6: Setting Powered False 16:02:37.278184 run create_hlr_db(pid=3582): Terminated: ok {rc=0} 16:02:37.723964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3584): Launched 16:02:38.039666 run osmo-hlr_10.42.42.2(pid=3585): Launched 16:02:38.159858 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:38.707656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3587): Launched 16:02:39.021591 run osmo-stp_10.42.42.5(pid=3588): Launched 16:02:39.140681 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:39.678954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3590): Launched 16:02:39.800105 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:40.064079 run patchelf(pid=3591): Launched 16:02:40.239573 run osmo-stp_10.42.42.5(pid=3588): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3588)] 16:02:40.372602 run osmo-stp_10.42.42.5(pid=3588): stdout: | (launched: 2022-12-13_16:02:38.962848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:40.506561 run osmo-stp_10.42.42.5(pid=3588): stderr: | [0;m[38;5;43m20221213160239136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160239136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160239136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160239136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160239137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160239137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160239137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:40.640348 run osmo-stp_10.42.42.5(pid=3588): stdout: | (launched: 2022-12-13_16:02:38.962848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:40.767476 run osmo-stp_10.42.42.5(pid=3588): stderr: | [0;m[38;5;43m20221213160239136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160239136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160239136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160239136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160239137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160239137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160239137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:40.918160 run patchelf(pid=3591): Terminating (SIGINT) 16:02:41.093151 run patchelf(pid=3591): Terminated: ok {rc=0} 16:02:41.219482 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3588): Process ended prematurely: osmo-stp_10.42.42.5(pid=3588) [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3588)] [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 16:02:41.228386 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:02:41.255427 run osmo-hlr_10.42.42.2(pid=3585): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3585)] 16:02:41.303590 run osmo-hlr_10.42.42.2(pid=3585): stdout: | (launched: 2022-12-13_16:02:37.980657) 16:02:41.353307 run osmo-hlr_10.42.42.2(pid=3585): stderr: | [0;m[1;31m20221213160238159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160238159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160238159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160238159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160238159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160238159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160238171 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160238179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160238180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160238180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:41.403460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3584): Terminating (SIGTERM) 16:02:41.443743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3587): Terminating (SIGTERM) 16:02:41.484191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3590): Terminating (SIGTERM) 16:02:41.525305 --- ParallelTerminationStrategy: PID 3584 died... 16:02:41.544930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3584): Terminated: ok {rc=0} 16:02:41.590070 --- ParallelTerminationStrategy: PID 3587 died... 16:02:41.609310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3587): Terminated: ok {rc=0} 16:02:41.654287 --- ParallelTerminationStrategy: PID 3590 died... 16:02:41.673584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3590): Terminated: ok {rc=0} 16:02:41.758777 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:02:43.075704 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:02:43.083053 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:02:43.119071 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:02:43.159214 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:02:43.250443 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:02:43.285226 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:02:43.325318 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:02:43.921993 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:02:43.976309 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:43.987814 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:02:44.060877 tst cs_paging_gprs_active.py: using LAC 34704 16:02:44.194266 tst cs_paging_gprs_active.py: using RAC 24 16:02:44.325223 tst cs_paging_gprs_active.py: using CellId 34704 16:02:44.459442 tst cs_paging_gprs_active.py: using BVCI 34705 16:02:44.584185 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:44.595695 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:44.607021 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:44.618321 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:44.629849 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:44.641496 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:44.653299 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:44.664773 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:44.676445 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:02:44.796680 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:02:44.920519 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:02:45.148088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:45.487999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3595): Launched 16:02:45.784293 run iperf3-srv_10.42.42.10(pid=3596): Launched 16:02:45.915485 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:02:46.150640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:46.498513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3597): Launched 16:02:46.810666 run iperf3-srv_10.42.42.10(pid=3598): Launched 16:02:46.950373 tst cs_paging_gprs_active.py:38: start network... 16:02:47.182699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:47.708814 run create_hlr_db(pid=3599): Launched 16:02:47.838370 bus /gobi_6: Setting Powered False 16:02:48.904079 run create_hlr_db(pid=3599): Terminated: ok {rc=0} 16:02:49.354675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3601): Launched 16:02:49.673667 run osmo-hlr_10.42.42.2(pid=3602): Launched 16:02:49.796520 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:50.357857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3604): Launched 16:02:50.675099 run osmo-stp_10.42.42.5(pid=3605): Launched 16:02:50.796880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:51.340857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3607): Launched 16:02:51.461998 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:51.729331 run patchelf(pid=3608): Launched 16:02:51.906476 run osmo-stp_10.42.42.5(pid=3605): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3605)] 16:02:52.039854 run osmo-stp_10.42.42.5(pid=3605): stdout: | (launched: 2022-12-13_16:02:50.615903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:52.174725 run osmo-stp_10.42.42.5(pid=3605): stderr: | [0;m[38;5;43m20221213160250791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160250791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160250791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160250792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160250792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160250792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160250792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:52.310081 run osmo-stp_10.42.42.5(pid=3605): stdout: | (launched: 2022-12-13_16:02:50.615903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:52.439445 run osmo-stp_10.42.42.5(pid=3605): stderr: | [0;m[38;5;43m20221213160250791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160250791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160250791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160250792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160250792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160250792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160250792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:52.593181 run patchelf(pid=3608): Terminating (SIGINT) 16:02:52.770283 run patchelf(pid=3608): Terminated: ok {rc=0} 16:02:52.897915 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3605): Process ended prematurely: osmo-stp_10.42.42.5(pid=3605) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3605)] [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:02:52.907729 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:02:52.935071 run osmo-hlr_10.42.42.2(pid=3602): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3602)] 16:02:52.982932 run osmo-hlr_10.42.42.2(pid=3602): stdout: | (launched: 2022-12-13_16:02:49.614604) 16:02:53.033334 run osmo-hlr_10.42.42.2(pid=3602): stderr: | [0;m[1;31m20221213160249798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160249798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160249798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160249798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160249798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160249798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160249809 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160249817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160249817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160249817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:53.083714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3595): Terminating (SIGTERM) 16:02:53.124020 run iperf3-srv_10.42.42.10(pid=3596): Terminating (SIGTERM) 16:02:53.164903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3597): Terminating (SIGTERM) 16:02:53.208604 run iperf3-srv_10.42.42.10(pid=3598): Terminating (SIGTERM) 16:02:53.251198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3601): Terminating (SIGTERM) 16:02:53.294084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3604): Terminating (SIGTERM) 16:02:53.336305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3607): Terminating (SIGTERM) 16:02:53.379332 --- ParallelTerminationStrategy: PID 3595 died... 16:02:53.399981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3595): Terminated: ok {rc=0} 16:02:53.447338 --- ParallelTerminationStrategy: PID 3596 died... 16:02:53.467278 run iperf3-srv_10.42.42.10(pid=3596): Terminated {rc=256} 16:02:53.514497 --- ParallelTerminationStrategy: PID 3597 died... 16:02:53.534346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3597): Terminated: ok {rc=0} 16:02:53.581035 --- ParallelTerminationStrategy: PID 3598 died... 16:02:53.600819 run iperf3-srv_10.42.42.10(pid=3598): Terminated {rc=256} 16:02:53.647247 --- ParallelTerminationStrategy: PID 3601 died... 16:02:53.667234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3601): Terminated: ok {rc=0} 16:02:53.713724 --- ParallelTerminationStrategy: PID 3604 died... 16:02:53.733834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3604): Terminated: ok {rc=0} 16:02:53.780296 --- ParallelTerminationStrategy: PID 3607 died... 16:02:53.800292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3607): Terminated: ok {rc=0} 16:02:53.889139 bus /gobi_0: Setting Powered False 16:02:54.989397 bus /gobi_0: Setting Powered False 16:02:56.105112 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:02:57.256872 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:57.269191 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:02:57.348518 tst iperf3.py: using LAC 34705 16:02:57.479684 tst iperf3.py: using RAC 25 16:02:57.611638 tst iperf3.py: using CellId 34705 16:02:57.742328 tst iperf3.py: using BVCI 34706 16:02:57.864606 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:57.876171 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:57.887516 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:57.898857 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:57.910572 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:57.922225 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:57.933958 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:57.945452 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:57.957148 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:02:58.076634 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:02:58.288118 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:58.607962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3609): Launched 16:02:58.885479 run iperf3-srv_10.42.42.10(pid=3610): Launched 16:02:59.003517 tst iperf3.py:8: start network... 16:02:59.214258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:59.702135 run create_hlr_db(pid=3611): Launched 16:02:59.831544 bus /gobi_6: Setting Powered False 16:03:00.912377 run create_hlr_db(pid=3611): Terminated: ok {rc=0} 16:03:01.398687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3614): Launched 16:03:01.762326 run osmo-hlr_10.42.42.2(pid=3615): Launched 16:03:02.072616 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:02.766671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3617): Launched 16:03:03.106642 run osmo-stp_10.42.42.5(pid=3618): Launched 16:03:03.235565 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:03.818308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3620): Launched 16:03:03.948042 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:04.234819 run patchelf(pid=3621): Launched 16:03:04.424158 run osmo-stp_10.42.42.5(pid=3618): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3618)] 16:03:04.566904 run osmo-stp_10.42.42.5(pid=3618): stdout: | (launched: 2022-12-13_16:03:03.043701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:04.711419 run osmo-stp_10.42.42.5(pid=3618): stderr: | [0;m[38;5;43m20221213160303240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160303240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160303241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160303241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160303242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160303242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160303242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:04.856260 run osmo-stp_10.42.42.5(pid=3618): stdout: | (launched: 2022-12-13_16:03:03.043701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:04.993932 run osmo-stp_10.42.42.5(pid=3618): stderr: | [0;m[38;5;43m20221213160303240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160303240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160303241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160303241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160303242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160303242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160303242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:05.157161 run patchelf(pid=3621): Terminating (SIGINT) 16:03:05.346112 run patchelf(pid=3621): Terminated: ok {rc=0} 16:03:05.483132 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3618): Process ended prematurely: osmo-stp_10.42.42.5(pid=3618) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3618)] [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 16:03:05.493570 tst iperf3.py:8: Test FAILED (8.3 sec) 16:03:05.522676 run osmo-hlr_10.42.42.2(pid=3615): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3615)] 16:03:05.573795 run osmo-hlr_10.42.42.2(pid=3615): stdout: | (launched: 2022-12-13_16:03:01.693402) 16:03:05.627384 run osmo-hlr_10.42.42.2(pid=3615): stderr: | [0;m[1;31m20221213160302135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160302135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160302135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160302135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160302135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160302135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160302154 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160302163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160302163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160302163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:05.681043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3609): Terminating (SIGTERM) 16:03:05.723346 run iperf3-srv_10.42.42.10(pid=3610): Terminating (SIGTERM) 16:03:05.766897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3614): Terminating (SIGTERM) 16:03:05.809592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3617): Terminating (SIGTERM) 16:03:05.852726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3620): Terminating (SIGTERM) 16:03:05.895765 --- ParallelTerminationStrategy: PID 3609 died... 16:03:05.916554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3609): Terminated: ok {rc=0} 16:03:05.963503 --- ParallelTerminationStrategy: PID 3610 died... 16:03:05.983510 run iperf3-srv_10.42.42.10(pid=3610): Terminated {rc=256} 16:03:06.030079 --- ParallelTerminationStrategy: PID 3614 died... 16:03:06.049966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3614): Terminated: ok {rc=0} 16:03:06.096727 --- ParallelTerminationStrategy: PID 3617 died... 16:03:06.116756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3617): Terminated: ok {rc=0} 16:03:06.163209 --- ParallelTerminationStrategy: PID 3620 died... 16:03:06.183294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3620): Terminated: ok {rc=0} 16:03:06.272386 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:03:07.425453 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:07.438255 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:03:07.511130 tst iperf3m4.py: using LAC 34706 16:03:07.644021 tst iperf3m4.py: using RAC 26 16:03:07.777231 tst iperf3m4.py: using CellId 34706 16:03:07.908358 tst iperf3m4.py: using BVCI 34707 16:03:08.030857 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:08.042299 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:08.053590 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:08.064780 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:08.076328 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:08.087967 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:08.099687 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:08.111194 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:08.122913 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:03:08.243026 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:03:08.369739 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:03:08.496404 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:03:08.619834 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:03:08.847932 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:09.187843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3623): Launched 16:03:09.484579 run iperf3-srv_10.42.42.10(pid=3624): Launched 16:03:09.613737 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:03:09.842645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:10.184052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3625): Launched 16:03:10.481800 run iperf3-srv_10.42.42.10(pid=3626): Launched 16:03:10.609350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:03:10.836125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:11.175848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3627): Launched 16:03:11.471012 run iperf3-srv_10.42.42.10(pid=3628): Launched 16:03:11.599459 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:03:11.826395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:12.166713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3629): Launched 16:03:12.461687 run iperf3-srv_10.42.42.10(pid=3630): Launched 16:03:12.588506 tst iperf3m4.py:8: start network... 16:03:12.815543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:13.338928 run create_hlr_db(pid=3631): Launched 16:03:13.468357 bus /gobi_6: Setting Powered False 16:03:14.534740 run create_hlr_db(pid=3631): Terminated: ok {rc=0} 16:03:14.985407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3633): Launched 16:03:15.302092 run osmo-hlr_10.42.42.2(pid=3634): Launched 16:03:15.427892 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:16.005725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3636): Launched 16:03:16.398976 run osmo-stp_10.42.42.5(pid=3637): Launched 16:03:16.712389 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:17.266996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3639): Launched 16:03:17.391923 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:17.659836 run patchelf(pid=3640): Launched 16:03:17.838208 run osmo-stp_10.42.42.5(pid=3637): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3637)] 16:03:17.971502 run osmo-stp_10.42.42.5(pid=3637): stdout: | (launched: 2022-12-13_16:03:16.335659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:18.106839 run osmo-stp_10.42.42.5(pid=3637): stderr: | [0;m[38;5;43m20221213160316541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160316542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160316542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160316542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160316543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160316543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160316543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:18.242286 run osmo-stp_10.42.42.5(pid=3637): stdout: | (launched: 2022-12-13_16:03:16.335659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:18.371011 run osmo-stp_10.42.42.5(pid=3637): stderr: | [0;m[38;5;43m20221213160316541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160316542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160316542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160316542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160316543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160316543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160316543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:18.523706 run patchelf(pid=3640): Terminating (SIGINT) 16:03:18.702043 run patchelf(pid=3640): Terminated: ok {rc=0} 16:03:18.830218 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3637): Process ended prematurely: osmo-stp_10.42.42.5(pid=3637) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3637)] [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:03:18.839802 tst iperf3m4.py:8: Test FAILED (11.5 sec) 16:03:18.867497 run osmo-hlr_10.42.42.2(pid=3634): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3634)] 16:03:18.915462 run osmo-hlr_10.42.42.2(pid=3634): stdout: | (launched: 2022-12-13_16:03:15.242743) 16:03:18.965795 run osmo-hlr_10.42.42.2(pid=3634): stderr: | [0;m[1;31m20221213160315420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160315420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160315420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160315420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160315420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160315420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160315434 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160315442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160315443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160315443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:19.015998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3623): Terminating (SIGTERM) 16:03:19.056195 run iperf3-srv_10.42.42.10(pid=3624): Terminating (SIGTERM) 16:03:19.096244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3625): Terminating (SIGTERM) 16:03:19.136487 run iperf3-srv_10.42.42.10(pid=3626): Terminating (SIGTERM) 16:03:19.176753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3627): Terminating (SIGTERM) 16:03:19.217344 run iperf3-srv_10.42.42.10(pid=3628): Terminating (SIGTERM) 16:03:19.257678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3629): Terminating (SIGTERM) 16:03:19.298133 run iperf3-srv_10.42.42.10(pid=3630): Terminating (SIGTERM) 16:03:19.338559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3633): Terminating (SIGTERM) 16:03:19.379487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3636): Terminating (SIGTERM) 16:03:19.420126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3639): Terminating (SIGTERM) 16:03:19.461092 --- ParallelTerminationStrategy: PID 3623 died... 16:03:19.480763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3623): Terminated: ok {rc=0} 16:03:19.525904 --- ParallelTerminationStrategy: PID 3624 died... 16:03:19.544774 run iperf3-srv_10.42.42.10(pid=3624): Terminated {rc=256} 16:03:19.589749 --- ParallelTerminationStrategy: PID 3625 died... 16:03:19.608718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3625): Terminated: ok {rc=0} 16:03:19.653528 --- ParallelTerminationStrategy: PID 3626 died... 16:03:19.672545 run iperf3-srv_10.42.42.10(pid=3626): Terminated {rc=256} 16:03:19.717260 --- ParallelTerminationStrategy: PID 3627 died... 16:03:19.736333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3627): Terminated: ok {rc=0} 16:03:19.781076 --- ParallelTerminationStrategy: PID 3628 died... 16:03:19.800340 run iperf3-srv_10.42.42.10(pid=3628): Terminated {rc=256} 16:03:19.844937 --- ParallelTerminationStrategy: PID 3629 died... 16:03:19.864024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3629): Terminated: ok {rc=0} 16:03:19.908781 --- ParallelTerminationStrategy: PID 3630 died... 16:03:19.927907 run iperf3-srv_10.42.42.10(pid=3630): Terminated {rc=256} 16:03:19.972338 --- ParallelTerminationStrategy: PID 3633 died... 16:03:19.991451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3633): Terminated: ok {rc=0} 16:03:20.035894 --- ParallelTerminationStrategy: PID 3636 died... 16:03:20.054877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3636): Terminated: ok {rc=0} 16:03:20.099348 --- ParallelTerminationStrategy: PID 3639 died... 16:03:20.118604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3639): Terminated: ok {rc=0} 16:03:20.206723 bus /gobi_4: Setting Powered False 16:03:21.309316 bus /gobi_4: Setting Powered False 16:03:22.429459 bus /gobi_1: Setting Powered False 16:03:23.528661 bus /gobi_1: Setting Powered False 16:03:24.645544 bus /gobi_0: Setting Powered False 16:03:25.745899 bus /gobi_0: Setting Powered False 16:03:26.865451 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:03:27.969735 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:27.982486 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:03:28.056282 tst ping.py: using LAC 34707 16:03:28.187395 tst ping.py: using RAC 27 16:03:28.318305 tst ping.py: using CellId 34707 16:03:28.447876 tst ping.py: using BVCI 34708 16:03:28.567920 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:28.579525 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:28.590818 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:28.602172 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:28.613786 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:28.625445 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:28.637117 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:28.648647 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:03:28.767575 tst ping.py:19: start network... 16:03:28.974691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:29.455173 run create_hlr_db(pid=3641): Launched 16:03:29.584566 bus /gobi_6: Setting Powered False 16:03:30.646072 run create_hlr_db(pid=3641): Terminated: ok {rc=0} 16:03:31.141850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3643): Launched 16:03:31.492339 run osmo-hlr_10.42.42.2(pid=3644): Launched 16:03:31.695273 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:32.429664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3646): Launched 16:03:32.740783 run osmo-stp_10.42.42.5(pid=3647): Launched 16:03:32.859800 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:33.395880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3649): Launched 16:03:33.516932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:33.779738 run patchelf(pid=3650): Launched 16:03:33.952544 run osmo-stp_10.42.42.5(pid=3647): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3647)] 16:03:34.083404 run osmo-stp_10.42.42.5(pid=3647): stdout: | (launched: 2022-12-13_16:03:32.682833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:34.216541 run osmo-stp_10.42.42.5(pid=3647): stderr: | [0;m[38;5;43m20221213160332858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160332859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160332859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160332859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160332860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160332860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160332860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:34.349835 run osmo-stp_10.42.42.5(pid=3647): stdout: | (launched: 2022-12-13_16:03:32.682833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:34.476355 run osmo-stp_10.42.42.5(pid=3647): stderr: | [0;m[38;5;43m20221213160332858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160332859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160332859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160332859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160332860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160332860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160332860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:34.626545 run patchelf(pid=3650): Terminating (SIGINT) 16:03:34.801182 run patchelf(pid=3650): Terminated: ok {rc=0} 16:03:34.926521 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3647): Process ended prematurely: osmo-stp_10.42.42.5(pid=3647) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3647)] [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 16:03:34.935556 tst ping.py:22: Test FAILED (7.0 sec) 16:03:34.963041 run osmo-hlr_10.42.42.2(pid=3644): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3644)] 16:03:35.011876 run osmo-hlr_10.42.42.2(pid=3644): stdout: | (launched: 2022-12-13_16:03:31.429813) 16:03:35.062279 run osmo-hlr_10.42.42.2(pid=3644): stderr: | [0;m[1;31m20221213160331729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160331729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160331729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160331729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160331729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160331730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160331741 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160331751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160331751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160331751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:35.113429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3643): Terminating (SIGTERM) 16:03:35.153978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3646): Terminating (SIGTERM) 16:03:35.194507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3649): Terminating (SIGTERM) 16:03:35.235404 --- ParallelTerminationStrategy: PID 3643 died... 16:03:35.255185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3643): Terminated: ok {rc=0} 16:03:35.300353 --- ParallelTerminationStrategy: PID 3646 died... 16:03:35.319545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3646): Terminated: ok {rc=0} 16:03:35.364413 --- ParallelTerminationStrategy: PID 3649 died... 16:03:35.383459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3649): Terminated: ok {rc=0} 16:03:35.469251 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:03:36.558574 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:36.571519 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:03:36.647471 tst ping_idle_ping.py: using LAC 34708 16:03:36.778433 tst ping_idle_ping.py: using RAC 28 16:03:36.910453 tst ping_idle_ping.py: using CellId 34708 16:03:37.040350 tst ping_idle_ping.py: using BVCI 34709 16:03:37.161800 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:37.173403 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:37.184752 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:37.196183 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:37.207890 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:37.219599 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:37.231433 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:03:37.243088 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:03:37.362962 tst ping_idle_ping.py:24: start network... 16:03:37.571904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:38.062628 run create_hlr_db(pid=3651): Launched 16:03:38.193936 bus /gobi_6: Setting Powered False 16:03:39.255815 run create_hlr_db(pid=3651): Terminated: ok {rc=0} 16:03:39.690082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3653): Launched 16:03:40.002778 run osmo-hlr_10.42.42.2(pid=3654): Launched 16:03:40.123864 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:40.659584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3656): Launched 16:03:40.974704 run osmo-stp_10.42.42.5(pid=3657): Launched 16:03:41.095273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:41.631797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3659): Launched 16:03:41.753282 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:42.017388 run patchelf(pid=3660): Launched 16:03:42.191797 run osmo-stp_10.42.42.5(pid=3657): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3657)] 16:03:42.323109 run osmo-stp_10.42.42.5(pid=3657): stdout: | (launched: 2022-12-13_16:03:40.916253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:42.456758 run osmo-stp_10.42.42.5(pid=3657): stderr: | [0;m[38;5;43m20221213160341089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160341089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160341090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160341090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160341090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160341091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160341091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:42.590036 run osmo-stp_10.42.42.5(pid=3657): stdout: | (launched: 2022-12-13_16:03:40.916253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:42.716801 run osmo-stp_10.42.42.5(pid=3657): stderr: | [0;m[38;5;43m20221213160341089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160341089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160341090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160341090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160341090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160341091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160341091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:42.868260 run patchelf(pid=3660): Terminating (SIGINT) 16:03:43.042349 run patchelf(pid=3660): Terminated: ok {rc=0} 16:03:43.168097 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3657): Process ended prematurely: osmo-stp_10.42.42.5(pid=3657) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3657)] [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:03:43.177220 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:03:43.204309 run osmo-hlr_10.42.42.2(pid=3654): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3654)] 16:03:43.253101 run osmo-hlr_10.42.42.2(pid=3654): stdout: | (launched: 2022-12-13_16:03:39.944081) 16:03:43.303566 run osmo-hlr_10.42.42.2(pid=3654): stderr: | [0;m[1;31m20221213160340121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160340121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160340122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160340122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160340122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160340122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160340162 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160340172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160340172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160340173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:43.354340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3653): Terminating (SIGTERM) 16:03:43.394881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3656): Terminating (SIGTERM) 16:03:43.434991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3659): Terminating (SIGTERM) 16:03:43.475576 --- ParallelTerminationStrategy: PID 3653 died... 16:03:43.495044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3653): Terminated: ok {rc=0} 16:03:43.539334 --- ParallelTerminationStrategy: PID 3656 died... 16:03:43.558296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3656): Terminated: ok {rc=0} 16:03:43.602472 --- ParallelTerminationStrategy: PID 3659 died... 16:03:43.621375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3659): Terminated: ok {rc=0} 16:03:43.708034 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:03:45.019463 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:03:45.025812 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:03:45.059016 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:03:45.098922 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:03:45.186833 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:03:45.219699 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:03:45.258788 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:03:45.855308 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:03:45.924001 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:45.935538 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:03:46.006956 tst cs_paging_gprs_active.py: using LAC 34709 16:03:46.136585 tst cs_paging_gprs_active.py: using RAC 29 16:03:46.261213 tst cs_paging_gprs_active.py: using CellId 34709 16:03:46.438926 tst cs_paging_gprs_active.py: using BVCI 34710 16:03:46.568481 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:46.581812 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:46.594115 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:46.606171 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:46.618734 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:46.631326 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:46.643433 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:46.655530 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:46.667794 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:03:46.815711 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:03:46.971416 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:03:47.196912 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:47.527073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3664): Launched 16:03:47.809126 run iperf3-srv_10.42.42.10(pid=3665): Launched 16:03:47.931181 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:03:48.143960 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:48.464147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3666): Launched 16:03:48.743512 run iperf3-srv_10.42.42.10(pid=3667): Launched 16:03:48.863806 tst cs_paging_gprs_active.py:38: start network... 16:03:49.076071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:49.565630 run create_hlr_db(pid=3668): Launched 16:03:49.697551 bus /gobi_6: Setting Powered False 16:03:50.759901 run create_hlr_db(pid=3668): Terminated: ok {rc=0} 16:03:51.221151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3670): Launched 16:03:51.561028 run osmo-hlr_10.42.42.2(pid=3671): Launched 16:03:51.691909 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:52.276453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3673): Launched 16:03:52.617945 run osmo-stp_10.42.42.5(pid=3674): Launched 16:03:52.749453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:53.331928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3676): Launched 16:03:53.462159 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:53.748612 run patchelf(pid=3677): Launched 16:03:53.938613 run osmo-stp_10.42.42.5(pid=3674): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3674)] 16:03:54.081898 run osmo-stp_10.42.42.5(pid=3674): stdout: | (launched: 2022-12-13_16:03:52.554744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:54.227046 run osmo-stp_10.42.42.5(pid=3674): stderr: | [0;m[38;5;43m20221213160352751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160352751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160352752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160352752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160352753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160352753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160352753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:54.371979 run osmo-stp_10.42.42.5(pid=3674): stdout: | (launched: 2022-12-13_16:03:52.554744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:54.511007 run osmo-stp_10.42.42.5(pid=3674): stderr: | [0;m[38;5;43m20221213160352751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160352751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160352752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160352752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160352753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160352753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160352753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:54.675239 run patchelf(pid=3677): Terminating (SIGINT) 16:03:54.864490 run patchelf(pid=3677): Terminated: ok {rc=0} 16:03:55.001760 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3674): Process ended prematurely: osmo-stp_10.42.42.5(pid=3674) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3674)] [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:03:55.012204 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 16:03:55.041279 run osmo-hlr_10.42.42.2(pid=3671): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3671)] 16:03:55.092667 run osmo-hlr_10.42.42.2(pid=3671): stdout: | (launched: 2022-12-13_16:03:51.498472) 16:03:55.145686 run osmo-hlr_10.42.42.2(pid=3671): stderr: | [0;m[1;31m20221213160351702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160351702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160351702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160351702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160351702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160351702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160351715 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160351723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160351723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160351724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:55.199115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3664): Terminating (SIGTERM) 16:03:55.241483 run iperf3-srv_10.42.42.10(pid=3665): Terminating (SIGTERM) 16:03:55.284428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3666): Terminating (SIGTERM) 16:03:55.327399 run iperf3-srv_10.42.42.10(pid=3667): Terminating (SIGTERM) 16:03:55.370358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3670): Terminating (SIGTERM) 16:03:55.413120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3673): Terminating (SIGTERM) 16:03:55.456276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3676): Terminating (SIGTERM) 16:03:55.499622 --- ParallelTerminationStrategy: PID 3664 died... 16:03:55.520053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3664): Terminated: ok {rc=0} 16:03:55.567123 --- ParallelTerminationStrategy: PID 3665 died... 16:03:55.587017 run iperf3-srv_10.42.42.10(pid=3665): Terminated {rc=256} 16:03:55.633769 --- ParallelTerminationStrategy: PID 3666 died... 16:03:55.653860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3666): Terminated: ok {rc=0} 16:03:55.700510 --- ParallelTerminationStrategy: PID 3667 died... 16:03:55.720521 run iperf3-srv_10.42.42.10(pid=3667): Terminated {rc=256} 16:03:55.766945 --- ParallelTerminationStrategy: PID 3670 died... 16:03:55.786867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3670): Terminated: ok {rc=0} 16:03:55.833252 --- ParallelTerminationStrategy: PID 3673 died... 16:03:55.853284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3673): Terminated: ok {rc=0} 16:03:55.899814 --- ParallelTerminationStrategy: PID 3676 died... 16:03:55.919927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3676): Terminated: ok {rc=0} 16:03:56.009763 bus /gobi_0: Setting Powered False 16:03:57.110016 bus /gobi_0: Setting Powered False 16:03:58.229750 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:03:59.383023 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:59.395624 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:03:59.471646 tst iperf3.py: using LAC 34710 16:03:59.603067 tst iperf3.py: using RAC 30 16:03:59.738421 tst iperf3.py: using CellId 34710 16:03:59.869450 tst iperf3.py: using BVCI 34711 16:03:59.985524 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:59.996397 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:00.007313 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:00.018145 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:00.029389 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:00.040762 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:00.052372 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:00.063710 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:00.075172 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:04:00.194225 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:04:00.405795 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:04:00.723338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3678): Launched 16:04:01.025709 run iperf3-srv_10.42.42.10(pid=3679): Launched 16:04:01.158636 tst iperf3.py:8: start network... 16:04:01.400374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:01.940753 run create_hlr_db(pid=3680): Launched 16:04:02.100822 bus /gobi_6: Setting Powered False 16:04:03.166960 run create_hlr_db(pid=3680): Terminated: ok {rc=0} 16:04:03.634200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3682): Launched 16:04:03.973086 run osmo-hlr_10.42.42.2(pid=3683): Launched 16:04:04.103812 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:04.687174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3685): Launched 16:04:05.027914 run osmo-stp_10.42.42.5(pid=3686): Launched 16:04:05.158876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:05.743522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3688): Launched 16:04:05.873638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:06.160606 run patchelf(pid=3689): Launched 16:04:06.350007 run osmo-stp_10.42.42.5(pid=3686): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3686)] 16:04:06.492636 run osmo-stp_10.42.42.5(pid=3686): stdout: | (launched: 2022-12-13_16:04:04.965194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:06.637150 run osmo-stp_10.42.42.5(pid=3686): stderr: | [0;m[38;5;43m20221213160405159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160405159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160405159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160405160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160405160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160405160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160405160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:06.781864 run osmo-stp_10.42.42.5(pid=3686): stdout: | (launched: 2022-12-13_16:04:04.965194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:06.919823 run osmo-stp_10.42.42.5(pid=3686): stderr: | [0;m[38;5;43m20221213160405159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160405159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160405159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160405160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160405160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160405160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160405160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:07.084078 run patchelf(pid=3689): Terminating (SIGINT) 16:04:07.273330 run patchelf(pid=3689): Terminated: ok {rc=0} 16:04:07.410134 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3686): Process ended prematurely: osmo-stp_10.42.42.5(pid=3686) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3686)] [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 16:04:07.420563 tst iperf3.py:8: Test FAILED (8.1 sec) 16:04:07.450201 run osmo-hlr_10.42.42.2(pid=3683): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3683)] 16:04:07.502439 run osmo-hlr_10.42.42.2(pid=3683): stdout: | (launched: 2022-12-13_16:04:03.910402) 16:04:07.556301 run osmo-hlr_10.42.42.2(pid=3683): stderr: | [0;m[1;31m20221213160404114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160404114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160404114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160404114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160404114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160404114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160404126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160404134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160404134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160404134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:07.610189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3678): Terminating (SIGTERM) 16:04:07.652903 run iperf3-srv_10.42.42.10(pid=3679): Terminating (SIGTERM) 16:04:07.696299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3682): Terminating (SIGTERM) 16:04:07.739360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3685): Terminating (SIGTERM) 16:04:07.782044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3688): Terminating (SIGTERM) 16:04:07.825435 --- ParallelTerminationStrategy: PID 3678 died... 16:04:07.845979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3678): Terminated: ok {rc=0} 16:04:07.893304 --- ParallelTerminationStrategy: PID 3679 died... 16:04:07.913674 run iperf3-srv_10.42.42.10(pid=3679): Terminated {rc=256} 16:04:07.960880 --- ParallelTerminationStrategy: PID 3682 died... 16:04:07.981623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3682): Terminated: ok {rc=0} 16:04:08.028930 --- ParallelTerminationStrategy: PID 3685 died... 16:04:08.049627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3685): Terminated: ok {rc=0} 16:04:08.096924 --- ParallelTerminationStrategy: PID 3688 died... 16:04:08.117324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3688): Terminated: ok {rc=0} 16:04:08.207555 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:04:09.362162 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:09.374487 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:04:09.456679 tst iperf3m4.py: using LAC 34711 16:04:09.589694 tst iperf3m4.py: using RAC 31 16:04:09.720001 tst iperf3m4.py: using CellId 34711 16:04:09.851971 tst iperf3m4.py: using BVCI 34712 16:04:09.976491 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:09.988215 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:09.999561 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:10.010940 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:10.023016 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:10.035345 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:10.047763 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:10.059895 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:10.072180 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:04:10.195808 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:04:10.322012 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:04:10.445767 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:04:10.564680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:04:10.776563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:04:11.093803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3690): Launched 16:04:11.371181 run iperf3-srv_10.42.42.10(pid=3691): Launched 16:04:11.491646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:04:11.703008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:04:12.020376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3692): Launched 16:04:12.298351 run iperf3-srv_10.42.42.10(pid=3693): Launched 16:04:12.418309 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:04:12.628512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:04:12.945873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3694): Launched 16:04:13.223604 run iperf3-srv_10.42.42.10(pid=3695): Launched 16:04:13.343408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:04:13.553904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:04:13.871266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3696): Launched 16:04:14.148540 run iperf3-srv_10.42.42.10(pid=3697): Launched 16:04:14.269073 tst iperf3m4.py:8: start network... 16:04:14.478829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:14.969655 run create_hlr_db(pid=3698): Launched 16:04:15.099119 bus /gobi_6: Setting Powered False 16:04:16.159828 run create_hlr_db(pid=3698): Terminated: ok {rc=0} 16:04:16.608350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3700): Launched 16:04:16.932869 run osmo-hlr_10.42.42.2(pid=3701): Launched 16:04:17.193293 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:17.786466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3703): Launched 16:04:18.126286 run osmo-stp_10.42.42.5(pid=3704): Launched 16:04:18.257811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:18.840090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3706): Launched 16:04:18.970281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:19.257102 run patchelf(pid=3707): Launched 16:04:19.446892 run osmo-stp_10.42.42.5(pid=3704): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3704)] 16:04:19.589398 run osmo-stp_10.42.42.5(pid=3704): stdout: | (launched: 2022-12-13_16:04:18.063457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:19.733520 run osmo-stp_10.42.42.5(pid=3704): stderr: | [0;m[38;5;43m20221213160418257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160418257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160418257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160418258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160418258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160418258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160418258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:19.877953 run osmo-stp_10.42.42.5(pid=3704): stdout: | (launched: 2022-12-13_16:04:18.063457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:20.015421 run osmo-stp_10.42.42.5(pid=3704): stderr: | [0;m[38;5;43m20221213160418257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160418257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160418257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160418258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160418258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160418258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160418258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:20.179089 run patchelf(pid=3707): Terminating (SIGINT) 16:04:20.368304 run patchelf(pid=3707): Terminated: ok {rc=0} 16:04:20.504915 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3704): Process ended prematurely: osmo-stp_10.42.42.5(pid=3704) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3704)] [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:04:20.515353 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:04:20.544698 run osmo-hlr_10.42.42.2(pid=3701): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3701)] 16:04:20.595912 run osmo-hlr_10.42.42.2(pid=3701): stdout: | (launched: 2022-12-13_16:04:16.872556) 16:04:20.648482 run osmo-hlr_10.42.42.2(pid=3701): stderr: | [0;m[1;31m20221213160417168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160417168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160417168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160417168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160417168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160417168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160417181 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160417204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160417204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160417204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:20.701592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3690): Terminating (SIGTERM) 16:04:20.744554 run iperf3-srv_10.42.42.10(pid=3691): Terminating (SIGTERM) 16:04:20.787891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3692): Terminating (SIGTERM) 16:04:20.830797 run iperf3-srv_10.42.42.10(pid=3693): Terminating (SIGTERM) 16:04:20.873415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3694): Terminating (SIGTERM) 16:04:20.916298 run iperf3-srv_10.42.42.10(pid=3695): Terminating (SIGTERM) 16:04:20.959248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3696): Terminating (SIGTERM) 16:04:21.002802 run iperf3-srv_10.42.42.10(pid=3697): Terminating (SIGTERM) 16:04:21.045619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3700): Terminating (SIGTERM) 16:04:21.088573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3703): Terminating (SIGTERM) 16:04:21.131307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3706): Terminating (SIGTERM) 16:04:21.174826 --- ParallelTerminationStrategy: PID 3690 died... 16:04:21.195353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3690): Terminated: ok {rc=0} 16:04:21.242788 --- ParallelTerminationStrategy: PID 3691 died... 16:04:21.263004 run iperf3-srv_10.42.42.10(pid=3691): Terminated {rc=256} 16:04:21.310219 --- ParallelTerminationStrategy: PID 3692 died... 16:04:21.330580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3692): Terminated: ok {rc=0} 16:04:21.377736 --- ParallelTerminationStrategy: PID 3693 died... 16:04:21.397797 run iperf3-srv_10.42.42.10(pid=3693): Terminated {rc=256} 16:04:21.445445 --- ParallelTerminationStrategy: PID 3694 died... 16:04:21.465636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3694): Terminated: ok {rc=0} 16:04:21.513220 --- ParallelTerminationStrategy: PID 3695 died... 16:04:21.533340 run iperf3-srv_10.42.42.10(pid=3695): Terminated {rc=256} 16:04:21.580659 --- ParallelTerminationStrategy: PID 3696 died... 16:04:21.600939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3696): Terminated: ok {rc=0} 16:04:21.648775 --- ParallelTerminationStrategy: PID 3697 died... 16:04:21.669494 run iperf3-srv_10.42.42.10(pid=3697): Terminated {rc=256} 16:04:21.716795 --- ParallelTerminationStrategy: PID 3700 died... 16:04:21.737627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3700): Terminated: ok {rc=0} 16:04:21.785024 --- ParallelTerminationStrategy: PID 3703 died... 16:04:21.805365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3703): Terminated: ok {rc=0} 16:04:21.852662 --- ParallelTerminationStrategy: PID 3706 died... 16:04:21.873152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3706): Terminated: ok {rc=0} 16:04:21.963807 bus /gobi_4: Setting Powered False 16:04:23.064491 bus /gobi_4: Setting Powered False 16:04:24.182624 bus /gobi_1: Setting Powered False 16:04:25.282162 bus /gobi_1: Setting Powered False 16:04:26.400034 bus /gobi_0: Setting Powered False 16:04:27.499881 bus /gobi_0: Setting Powered False 16:04:28.620514 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:04:29.726932 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:29.739344 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:04:29.813602 tst ping.py: using LAC 34712 16:04:29.944669 tst ping.py: using RAC 32 16:04:30.075684 tst ping.py: using CellId 34712 16:04:30.207023 tst ping.py: using BVCI 34713 16:04:30.329583 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:30.341219 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:30.352622 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:30.364056 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:30.375870 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:30.387871 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:30.399751 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:30.411418 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:04:30.529881 tst ping.py:19: start network... 16:04:30.737272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:31.285687 run create_hlr_db(pid=3709): Launched 16:04:31.447773 bus /gobi_6: Setting Powered False 16:04:32.508729 run create_hlr_db(pid=3709): Terminated: ok {rc=0} 16:04:32.941692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3711): Launched 16:04:33.253714 run osmo-hlr_10.42.42.2(pid=3712): Launched 16:04:33.372751 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:33.951467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3714): Launched 16:04:34.283746 run osmo-stp_10.42.42.5(pid=3715): Launched 16:04:34.411444 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:34.982783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3717): Launched 16:04:35.109920 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:35.382939 run patchelf(pid=3718): Launched 16:04:35.556806 run osmo-stp_10.42.42.5(pid=3715): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3715)] 16:04:35.687378 run osmo-stp_10.42.42.5(pid=3715): stdout: | (launched: 2022-12-13_16:04:34.222236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:35.820072 run osmo-stp_10.42.42.5(pid=3715): stderr: | [0;m[38;5;43m20221213160434416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160434417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160434417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160434417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160434418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160434418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160434418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:35.952860 run osmo-stp_10.42.42.5(pid=3715): stdout: | (launched: 2022-12-13_16:04:34.222236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:36.078895 run osmo-stp_10.42.42.5(pid=3715): stderr: | [0;m[38;5;43m20221213160434416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160434417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160434417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160434417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160434418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160434418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160434418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:36.228018 run patchelf(pid=3718): Terminating (SIGINT) 16:04:36.401262 run patchelf(pid=3718): Terminated: ok {rc=0} 16:04:36.526245 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3715): Process ended prematurely: osmo-stp_10.42.42.5(pid=3715) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3715)] [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 16:04:36.535246 tst ping.py:22: Test FAILED (6.8 sec) 16:04:36.562387 run osmo-hlr_10.42.42.2(pid=3712): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3712)] 16:04:36.610678 run osmo-hlr_10.42.42.2(pid=3712): stdout: | (launched: 2022-12-13_16:04:33.194904) 16:04:36.660709 run osmo-hlr_10.42.42.2(pid=3712): stderr: | [0;m[1;31m20221213160433372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160433372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160433372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160433372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160433372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160433372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160433386 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160433394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160433394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160433394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:36.711184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3711): Terminating (SIGTERM) 16:04:36.751599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3714): Terminating (SIGTERM) 16:04:36.792201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3717): Terminating (SIGTERM) 16:04:36.832912 --- ParallelTerminationStrategy: PID 3711 died... 16:04:36.852407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3711): Terminated: ok {rc=0} 16:04:36.896890 --- ParallelTerminationStrategy: PID 3714 died... 16:04:36.916268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3714): Terminated: ok {rc=0} 16:04:36.961206 --- ParallelTerminationStrategy: PID 3717 died... 16:04:36.980209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3717): Terminated: ok {rc=0} 16:04:37.071333 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:04:38.158616 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:38.170924 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:04:38.243644 tst ping_idle_ping.py: using LAC 34713 16:04:38.367219 tst ping_idle_ping.py: using RAC 33 16:04:38.490700 tst ping_idle_ping.py: using CellId 34713 16:04:38.613370 tst ping_idle_ping.py: using BVCI 34714 16:04:38.725565 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:38.736553 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:38.747398 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:38.758250 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:38.768907 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:38.779754 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:38.790720 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:04:38.801616 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:04:38.918802 tst ping_idle_ping.py:24: start network... 16:04:39.127117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:39.612028 run create_hlr_db(pid=3719): Launched 16:04:39.741566 bus /gobi_6: Setting Powered False 16:04:40.807307 run create_hlr_db(pid=3719): Terminated: ok {rc=0} 16:04:41.270738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3721): Launched 16:04:41.605525 run osmo-hlr_10.42.42.2(pid=3722): Launched 16:04:41.732568 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:42.304236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3724): Launched 16:04:42.637861 run osmo-stp_10.42.42.5(pid=3725): Launched 16:04:42.767137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:43.339267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3727): Launched 16:04:43.468334 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:43.749999 run patchelf(pid=3728): Launched 16:04:43.936399 run osmo-stp_10.42.42.5(pid=3725): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3725)] 16:04:44.076428 run osmo-stp_10.42.42.5(pid=3725): stdout: | (launched: 2022-12-13_16:04:42.575852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:44.218857 run osmo-stp_10.42.42.5(pid=3725): stderr: | [0;m[38;5;43m20221213160442772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160442772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160442772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160442773 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160442773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160442773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160442773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:44.361579 run osmo-stp_10.42.42.5(pid=3725): stdout: | (launched: 2022-12-13_16:04:42.575852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:44.497528 run osmo-stp_10.42.42.5(pid=3725): stderr: | [0;m[38;5;43m20221213160442772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160442772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160442772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160442773 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160442773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160442773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160442773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:44.658461 run patchelf(pid=3728): Terminating (SIGINT) 16:04:44.844175 run patchelf(pid=3728): Terminated: ok {rc=0} 16:04:44.978028 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3725): Process ended prematurely: osmo-stp_10.42.42.5(pid=3725) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3725)] [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:04:44.987726 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:04:45.016150 run osmo-hlr_10.42.42.2(pid=3722): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3722)] 16:04:45.067548 run osmo-hlr_10.42.42.2(pid=3722): stdout: | (launched: 2022-12-13_16:04:41.543177) 16:04:45.120070 run osmo-hlr_10.42.42.2(pid=3722): stderr: | [0;m[1;31m20221213160441745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160441745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160441745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160441745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160441745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160441745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160441757 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160441765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160441765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160441766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:45.173482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3721): Terminating (SIGTERM) 16:04:45.216057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3724): Terminating (SIGTERM) 16:04:45.259266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3727): Terminating (SIGTERM) 16:04:45.302087 --- ParallelTerminationStrategy: PID 3721 died... 16:04:45.322764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3721): Terminated: ok {rc=0} 16:04:45.370713 --- ParallelTerminationStrategy: PID 3724 died... 16:04:45.390521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3724): Terminated: ok {rc=0} 16:04:45.434441 --- ParallelTerminationStrategy: PID 3727 died... 16:04:45.453113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3727): Terminated: ok {rc=0} 16:04:45.537642 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:04:46.891728 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:46.903731 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:04:46.953274 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 16:04:47.007219 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 16:04:47.102480 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:04:47.140723 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 16:04:47.183641 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 16:04:47.776533 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 16:04:47.833367 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:47.845211 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:04:47.901433 tst cs_paging_gprs_active.py: using LAC 34714 16:04:48.034314 tst cs_paging_gprs_active.py: using RAC 34 16:04:48.165709 tst cs_paging_gprs_active.py: using CellId 34714 16:04:48.299352 tst cs_paging_gprs_active.py: using BVCI 34715 16:04:48.424498 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:48.436445 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:48.448243 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:48.460399 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:48.473091 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:48.485738 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:48.498476 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:48.511137 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:48.523885 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:04:48.646460 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:04:48.771323 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:04:49.001973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:04:49.343571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3732): Launched 16:04:49.641548 run iperf3-srv_10.42.42.10(pid=3733): Launched 16:04:49.771115 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:04:50.000228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:04:50.342007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3734): Launched 16:04:50.639891 run iperf3-srv_10.42.42.10(pid=3735): Launched 16:04:50.766900 tst cs_paging_gprs_active.py:38: start network... 16:04:50.995151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:51.520210 run create_hlr_db(pid=3736): Launched 16:04:51.650231 bus /gobi_6: Setting Powered False 16:04:52.716414 run create_hlr_db(pid=3736): Terminated: ok {rc=0} 16:04:53.166744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3738): Launched 16:04:53.484761 run osmo-hlr_10.42.42.2(pid=3739): Launched 16:04:53.607593 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:54.151414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3741): Launched 16:04:54.470992 run osmo-stp_10.42.42.5(pid=3742): Launched 16:04:54.594339 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:55.140118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3744): Launched 16:04:55.263619 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:55.533131 run patchelf(pid=3745): Launched 16:04:55.710659 run osmo-stp_10.42.42.5(pid=3742): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3742)] 16:04:55.843974 run osmo-stp_10.42.42.5(pid=3742): stdout: | (launched: 2022-12-13_16:04:54.411711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:55.978909 run osmo-stp_10.42.42.5(pid=3742): stderr: | [0;m[38;5;43m20221213160454587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160454587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160454587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160454588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160454588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160454588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160454588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:56.113667 run osmo-stp_10.42.42.5(pid=3742): stdout: | (launched: 2022-12-13_16:04:54.411711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:56.242188 run osmo-stp_10.42.42.5(pid=3742): stderr: | [0;m[38;5;43m20221213160454587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160454587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160454587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160454588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160454588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160454588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160454588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:56.394702 run patchelf(pid=3745): Terminating (SIGINT) 16:04:56.571716 run patchelf(pid=3745): Terminated: ok {rc=0} 16:04:56.699293 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3742): Process ended prematurely: osmo-stp_10.42.42.5(pid=3742) [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3742)] [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 16:04:56.708889 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:04:56.736598 run osmo-hlr_10.42.42.2(pid=3739): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3739)] 16:04:56.784875 run osmo-hlr_10.42.42.2(pid=3739): stdout: | (launched: 2022-12-13_16:04:53.426036) 16:04:56.835171 run osmo-hlr_10.42.42.2(pid=3739): stderr: | [0;m[1;31m20221213160453605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160453605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160453605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160453605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160453605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160453605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160453619 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160453627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160453627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160453627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:56.885936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3732): Terminating (SIGTERM) 16:04:56.926426 run iperf3-srv_10.42.42.10(pid=3733): Terminating (SIGTERM) 16:04:56.966916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3734): Terminating (SIGTERM) 16:04:57.007472 run iperf3-srv_10.42.42.10(pid=3735): Terminating (SIGTERM) 16:04:57.047847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3738): Terminating (SIGTERM) 16:04:57.088338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3741): Terminating (SIGTERM) 16:04:57.128910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3744): Terminating (SIGTERM) 16:04:57.169798 --- ParallelTerminationStrategy: PID 3732 died... 16:04:57.189255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3732): Terminated: ok {rc=0} 16:04:57.233886 --- ParallelTerminationStrategy: PID 3733 died... 16:04:57.252740 run iperf3-srv_10.42.42.10(pid=3733): Terminated {rc=256} 16:04:57.297230 --- ParallelTerminationStrategy: PID 3734 died... 16:04:57.315966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3734): Terminated: ok {rc=0} 16:04:57.360494 --- ParallelTerminationStrategy: PID 3735 died... 16:04:57.379367 run iperf3-srv_10.42.42.10(pid=3735): Terminated {rc=256} 16:04:57.424093 --- ParallelTerminationStrategy: PID 3738 died... 16:04:57.443247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3738): Terminated: ok {rc=0} 16:04:57.488055 --- ParallelTerminationStrategy: PID 3741 died... 16:04:57.507130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3741): Terminated: ok {rc=0} 16:04:57.551664 --- ParallelTerminationStrategy: PID 3744 died... 16:04:57.570612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3744): Terminated: ok {rc=0} 16:04:57.658078 bus /gobi_0: Setting Powered False 16:04:58.760278 bus /gobi_0: Setting Powered False 16:04:59.878329 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 16:05:01.059766 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:01.076643 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:05:01.147749 tst iperf3.py: using LAC 34715 16:05:01.340341 tst iperf3.py: using RAC 35 16:05:01.470268 tst iperf3.py: using CellId 34715 16:05:01.632024 tst iperf3.py: using BVCI 34716 16:05:01.758270 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:01.771133 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:01.785234 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:01.798169 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:01.813545 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:01.827775 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:01.841977 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:01.855834 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:01.869999 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:05:01.999419 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:05:02.238314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:05:02.583230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3749): Launched 16:05:02.880212 run iperf3-srv_10.42.42.10(pid=3750): Launched 16:05:03.010211 tst iperf3.py:8: start network... 16:05:03.239061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:03.765655 run create_hlr_db(pid=3751): Launched 16:05:03.895738 bus /gobi_6: Setting Powered False 16:05:04.961295 run create_hlr_db(pid=3751): Terminated: ok {rc=0} 16:05:05.412386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3753): Launched 16:05:05.732559 run osmo-hlr_10.42.42.2(pid=3754): Launched 16:05:05.856099 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:06.414920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3756): Launched 16:05:06.733712 run osmo-stp_10.42.42.5(pid=3757): Launched 16:05:06.854399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:05:07.399894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3759): Launched 16:05:07.523719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:05:07.792315 run patchelf(pid=3760): Launched 16:05:07.968720 run osmo-stp_10.42.42.5(pid=3757): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3757)] 16:05:08.116509 run osmo-stp_10.42.42.5(pid=3757): stdout: | (launched: 2022-12-13_16:05:06.674722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:08.246804 run osmo-stp_10.42.42.5(pid=3757): stderr: | [0;m[38;5;43m20221213160506851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160506851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160506852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160506852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160506853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160506853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160506853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:08.376932 run osmo-stp_10.42.42.5(pid=3757): stdout: | (launched: 2022-12-13_16:05:06.674722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:08.501191 run osmo-stp_10.42.42.5(pid=3757): stderr: | [0;m[38;5;43m20221213160506851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160506851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160506852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160506852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160506853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160506853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160506853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:08.647925 run patchelf(pid=3760): Terminating (SIGINT) 16:05:08.818781 run patchelf(pid=3760): Terminated: ok {rc=0} 16:05:08.941317 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3757): Process ended prematurely: osmo-stp_10.42.42.5(pid=3757) [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3757)] [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 16:05:08.950746 tst iperf3.py:8: Test FAILED (7.9 sec) 16:05:08.977822 run osmo-hlr_10.42.42.2(pid=3754): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3754)] 16:05:09.024814 run osmo-hlr_10.42.42.2(pid=3754): stdout: | (launched: 2022-12-13_16:05:05.673390) 16:05:09.073533 run osmo-hlr_10.42.42.2(pid=3754): stderr: | [0;m[1;31m20221213160505857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160505857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160505857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160505857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160505857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160505857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160505869 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160505878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160505878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160505878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:09.122651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3749): Terminating (SIGTERM) 16:05:09.161865 run iperf3-srv_10.42.42.10(pid=3750): Terminating (SIGTERM) 16:05:09.201050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3753): Terminating (SIGTERM) 16:05:09.240289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3756): Terminating (SIGTERM) 16:05:09.279557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3759): Terminating (SIGTERM) 16:05:09.318912 --- ParallelTerminationStrategy: PID 3749 died... 16:05:09.337731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3749): Terminated: ok {rc=0} 16:05:09.380901 --- ParallelTerminationStrategy: PID 3750 died... 16:05:09.399228 run iperf3-srv_10.42.42.10(pid=3750): Terminated {rc=256} 16:05:09.442079 --- ParallelTerminationStrategy: PID 3753 died... 16:05:09.460165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3753): Terminated: ok {rc=0} 16:05:09.503324 --- ParallelTerminationStrategy: PID 3756 died... 16:05:09.521971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3756): Terminated: ok {rc=0} 16:05:09.565189 --- ParallelTerminationStrategy: PID 3759 died... 16:05:09.583466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3759): Terminated: ok {rc=0} 16:05:09.668675 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 16:05:10.815340 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:10.827294 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:05:10.882494 tst iperf3m4.py: using LAC 34716 16:05:11.002420 tst iperf3m4.py: using RAC 36 16:05:11.123663 tst iperf3m4.py: using CellId 34716 16:05:11.245895 tst iperf3m4.py: using BVCI 34717 16:05:11.357855 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:11.369263 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:11.380370 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:11.391502 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:11.402505 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:11.413565 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:11.424660 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:11.436917 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:11.448588 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:05:11.566170 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:05:11.689213 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:05:11.807436 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:05:11.928431 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:05:12.149768 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:05:12.478877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3761): Launched 16:05:12.764750 run iperf3-srv_10.42.42.10(pid=3762): Launched 16:05:12.889591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:05:13.109073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:05:13.437702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3763): Launched 16:05:13.723506 run iperf3-srv_10.42.42.10(pid=3764): Launched 16:05:13.846136 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:05:14.066554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:05:14.395839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3765): Launched 16:05:14.682380 run iperf3-srv_10.42.42.10(pid=3766): Launched 16:05:14.807182 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:05:15.027031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:05:15.355285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3767): Launched 16:05:15.641520 run iperf3-srv_10.42.42.10(pid=3768): Launched 16:05:15.763914 tst iperf3m4.py:8: start network... 16:05:15.986906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:16.508191 run create_hlr_db(pid=3769): Launched 16:05:16.671704 bus /gobi_6: Setting Powered False 16:05:17.735498 run create_hlr_db(pid=3769): Terminated: ok {rc=0} 16:05:18.170389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3771): Launched 16:05:18.476545 run osmo-hlr_10.42.42.2(pid=3772): Launched 16:05:18.593547 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:19.140336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3774): Launched 16:05:19.445912 run osmo-stp_10.42.42.5(pid=3775): Launched 16:05:19.564373 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:05:20.101064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3777): Launched 16:05:20.219949 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:05:20.482422 run patchelf(pid=3778): Launched 16:05:20.656553 run osmo-stp_10.42.42.5(pid=3775): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3775)] 16:05:20.786862 run osmo-stp_10.42.42.5(pid=3775): stdout: | (launched: 2022-12-13_16:05:19.388340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:20.919137 run osmo-stp_10.42.42.5(pid=3775): stderr: | [0;m[38;5;43m20221213160519558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160519558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160519558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160519559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160519559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160519559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160519559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:21.051127 run osmo-stp_10.42.42.5(pid=3775): stdout: | (launched: 2022-12-13_16:05:19.388340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:21.177601 run osmo-stp_10.42.42.5(pid=3775): stderr: | [0;m[38;5;43m20221213160519558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160519558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160519558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160519559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160519559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160519559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160519559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:21.327260 run patchelf(pid=3778): Terminating (SIGINT) 16:05:21.500854 run patchelf(pid=3778): Terminated: ok {rc=0} 16:05:21.626948 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3775): Process ended prematurely: osmo-stp_10.42.42.5(pid=3775) [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3775)] [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 16:05:21.636754 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:05:21.664329 run osmo-hlr_10.42.42.2(pid=3772): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3772)] 16:05:21.711527 run osmo-hlr_10.42.42.2(pid=3772): stdout: | (launched: 2022-12-13_16:05:18.419132) 16:05:21.760356 run osmo-hlr_10.42.42.2(pid=3772): stderr: | [0;m[1;31m20221213160518594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160518594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160518594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160518594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160518594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160518594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160518607 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160518615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160518616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160518616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:21.809822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3761): Terminating (SIGTERM) 16:05:21.849202 run iperf3-srv_10.42.42.10(pid=3762): Terminating (SIGTERM) 16:05:21.888749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3763): Terminating (SIGTERM) 16:05:21.928236 run iperf3-srv_10.42.42.10(pid=3764): Terminating (SIGTERM) 16:05:21.967286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3765): Terminating (SIGTERM) 16:05:22.006418 run iperf3-srv_10.42.42.10(pid=3766): Terminating (SIGTERM) 16:05:22.045420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3767): Terminating (SIGTERM) 16:05:22.084903 run iperf3-srv_10.42.42.10(pid=3768): Terminating (SIGTERM) 16:05:22.124093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3771): Terminating (SIGTERM) 16:05:22.163269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3774): Terminating (SIGTERM) 16:05:22.202414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3777): Terminating (SIGTERM) 16:05:22.241837 --- ParallelTerminationStrategy: PID 3761 died... 16:05:22.260599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3761): Terminated: ok {rc=0} 16:05:22.304338 --- ParallelTerminationStrategy: PID 3762 died... 16:05:22.322627 run iperf3-srv_10.42.42.10(pid=3762): Terminated {rc=256} 16:05:22.366071 --- ParallelTerminationStrategy: PID 3763 died... 16:05:22.384468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3763): Terminated: ok {rc=0} 16:05:22.427653 --- ParallelTerminationStrategy: PID 3764 died... 16:05:22.446080 run iperf3-srv_10.42.42.10(pid=3764): Terminated {rc=256} 16:05:22.489235 --- ParallelTerminationStrategy: PID 3765 died... 16:05:22.507489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3765): Terminated: ok {rc=0} 16:05:22.551099 --- ParallelTerminationStrategy: PID 3766 died... 16:05:22.569594 run iperf3-srv_10.42.42.10(pid=3766): Terminated {rc=256} 16:05:22.612790 --- ParallelTerminationStrategy: PID 3767 died... 16:05:22.631267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3767): Terminated: ok {rc=0} 16:05:22.674609 --- ParallelTerminationStrategy: PID 3768 died... 16:05:22.693000 run iperf3-srv_10.42.42.10(pid=3768): Terminated {rc=256} 16:05:22.736013 --- ParallelTerminationStrategy: PID 3771 died... 16:05:22.754352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3771): Terminated: ok {rc=0} 16:05:22.797540 --- ParallelTerminationStrategy: PID 3774 died... 16:05:22.815995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3774): Terminated: ok {rc=0} 16:05:22.859099 --- ParallelTerminationStrategy: PID 3777 died... 16:05:22.877462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3777): Terminated: ok {rc=0} 16:05:22.962781 bus /gobi_4: Setting Powered False 16:05:24.061399 bus /gobi_4: Setting Powered False 16:05:25.176561 bus /gobi_1: Setting Powered False 16:05:26.271927 bus /gobi_1: Setting Powered False 16:05:27.387610 bus /gobi_0: Setting Powered False 16:05:28.486021 bus /gobi_0: Setting Powered False 16:05:29.598138 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 16:05:30.699765 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:30.712307 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:05:30.768476 tst ping.py: using LAC 34717 16:05:30.923172 tst ping.py: using RAC 37 16:05:31.047405 tst ping.py: using CellId 34717 16:05:31.175952 tst ping.py: using BVCI 34718 16:05:31.297063 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:31.309926 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:31.322435 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:31.334840 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:31.347474 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:31.360126 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:31.372821 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:31.385521 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:05:31.509856 tst ping.py:19: start network... 16:05:31.790874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:32.282260 run create_hlr_db(pid=3779): Launched 16:05:32.421457 bus /gobi_6: Setting Powered False 16:05:33.481954 run create_hlr_db(pid=3779): Terminated: ok {rc=0} 16:05:33.928092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3781): Launched 16:05:34.257655 run osmo-hlr_10.42.42.2(pid=3782): Launched 16:05:34.382250 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:34.911430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3784): Launched 16:05:35.216875 run osmo-stp_10.42.42.5(pid=3785): Launched 16:05:35.332642 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:05:35.857662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3787): Launched 16:05:35.974826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:05:36.233456 run patchelf(pid=3788): Launched 16:05:36.404161 run osmo-stp_10.42.42.5(pid=3785): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3785)] 16:05:36.532383 run osmo-stp_10.42.42.5(pid=3785): stdout: | (launched: 2022-12-13_16:05:35.160118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:36.662918 run osmo-stp_10.42.42.5(pid=3785): stderr: | [0;m[38;5;43m20221213160535330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160535331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160535331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160535331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160535332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160535332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160535332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:36.793264 run osmo-stp_10.42.42.5(pid=3785): stdout: | (launched: 2022-12-13_16:05:35.160118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:36.917749 run osmo-stp_10.42.42.5(pid=3785): stderr: | [0;m[38;5;43m20221213160535330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160535331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160535331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160535331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160535332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160535332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160535332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:37.064922 run patchelf(pid=3788): Terminating (SIGINT) 16:05:37.236323 run patchelf(pid=3788): Terminated: ok {rc=0} 16:05:37.359981 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3785): Process ended prematurely: osmo-stp_10.42.42.5(pid=3785) [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3785)] [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 16:05:37.369004 tst ping.py:22: Test FAILED (6.7 sec) 16:05:37.395814 run osmo-hlr_10.42.42.2(pid=3782): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3782)] 16:05:37.443188 run osmo-hlr_10.42.42.2(pid=3782): stdout: | (launched: 2022-12-13_16:05:34.197437) 16:05:37.492838 run osmo-hlr_10.42.42.2(pid=3782): stderr: | [0;m[1;31m20221213160534396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160534396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160534396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160534396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160534396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160534396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160534410 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160534420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160534420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160534420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:37.542838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3781): Terminating (SIGTERM) 16:05:37.582453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3784): Terminating (SIGTERM) 16:05:37.622190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3787): Terminating (SIGTERM) 16:05:37.662167 --- ParallelTerminationStrategy: PID 3781 died... 16:05:37.681423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3781): Terminated: ok {rc=0} 16:05:37.725330 --- ParallelTerminationStrategy: PID 3784 died... 16:05:37.744360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3784): Terminated: ok {rc=0} 16:05:37.788921 --- ParallelTerminationStrategy: PID 3787 died... 16:05:37.808326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3787): Terminated: ok {rc=0} 16:05:37.895038 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 16:05:38.982350 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:38.994498 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:05:39.048664 tst ping_idle_ping.py: using LAC 34718 16:05:39.181329 tst ping_idle_ping.py: using RAC 38 16:05:39.307753 tst ping_idle_ping.py: using CellId 34718 16:05:39.433186 tst ping_idle_ping.py: using BVCI 34719 16:05:39.552099 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:39.564105 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:39.575833 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:39.587598 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:39.599579 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:39.611823 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:39.623927 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:05:39.635923 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:05:39.752355 tst ping_idle_ping.py:24: start network... 16:05:39.956846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:40.431013 run create_hlr_db(pid=3789): Launched 16:05:40.556588 bus /gobi_6: Setting Powered False 16:05:41.617648 run create_hlr_db(pid=3789): Terminated: ok {rc=0} 16:05:42.063100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3791): Launched 16:05:42.389609 run osmo-hlr_10.42.42.2(pid=3792): Launched 16:05:42.513904 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:43.075203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3794): Launched 16:05:43.402813 run osmo-stp_10.42.42.5(pid=3795): Launched 16:05:43.529206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:05:44.090748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3797): Launched 16:05:44.217154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:05:44.492865 run patchelf(pid=3798): Launched 16:05:44.674884 run osmo-stp_10.42.42.5(pid=3795): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3795)] 16:05:44.812384 run osmo-stp_10.42.42.5(pid=3795): stdout: | (launched: 2022-12-13_16:05:43.343164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:44.952336 run osmo-stp_10.42.42.5(pid=3795): stderr: | [0;m[38;5;43m20221213160543531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160543531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160543532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160543532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160543533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160543533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160543533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:45.092302 run osmo-stp_10.42.42.5(pid=3795): stdout: | (launched: 2022-12-13_16:05:43.343164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:45.225415 run osmo-stp_10.42.42.5(pid=3795): stderr: | [0;m[38;5;43m20221213160543531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160543531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160543532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160543532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160543533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160543533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160543533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:45.383328 run patchelf(pid=3798): Terminating (SIGINT) 16:05:45.566442 run patchelf(pid=3798): Terminated: ok {rc=0} 16:05:45.698156 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3795): Process ended prematurely: osmo-stp_10.42.42.5(pid=3795) [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3795)] [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 16:05:45.707859 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:05:45.736153 run osmo-hlr_10.42.42.2(pid=3792): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3792)] 16:05:45.786801 run osmo-hlr_10.42.42.2(pid=3792): stdout: | (launched: 2022-12-13_16:05:42.329436) 16:05:45.843830 run osmo-hlr_10.42.42.2(pid=3792): stderr: | [0;m[1;31m20221213160542523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160542523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160542523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160542523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160542523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160542523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160542536 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160542544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160542545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160542545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:45.919716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3791): Terminating (SIGTERM) 16:05:45.963279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3794): Terminating (SIGTERM) 16:05:46.009937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3797): Terminating (SIGTERM) 16:05:46.075458 --- ParallelTerminationStrategy: PID 3791 died... 16:05:46.096291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3791): Terminated: ok {rc=0} 16:05:46.145795 --- ParallelTerminationStrategy: PID 3794 died... 16:05:46.167509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3794): Terminated: ok {rc=0} 16:05:46.215753 --- ParallelTerminationStrategy: PID 3797 died... 16:05:46.237536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3797): Terminated: ok {rc=0} 16:05:46.335987 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:05:47.664210 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:05:47.671497 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:05:47.705699 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:05:47.742970 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:05:47.798393 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:05:47.832889 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:05:47.869439 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:05:48.424152 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:05:48.429574 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:05:48.441046 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:05:48.515990 tst switch_tch_pdch.py: using LAC 34719 16:05:48.634721 tst switch_tch_pdch.py: using RAC 39 16:05:48.751765 tst switch_tch_pdch.py: using CellId 34719 16:05:48.868745 tst switch_tch_pdch.py: using BVCI 34720 16:05:48.988866 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:05:49.000776 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:05:49.012518 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:05:49.024293 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:05:49.036527 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:05:49.048614 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:05:49.060859 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:05:49.072801 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:05:49.190311 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:05:49.311875 tst switch_tch_pdch.py:51: start network... 16:05:49.529484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:50.027845 run create_hlr_db(pid=3805): Launched 16:05:50.152305 bus /gobi_6: Setting Powered False 16:05:51.216185 run create_hlr_db(pid=3805): Terminated: ok {rc=0} 16:05:51.647991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3807): Launched 16:05:51.964097 run osmo-hlr_10.42.42.2(pid=3809): Launched 16:05:52.081243 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:52.609671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3811): Launched 16:05:52.913785 run osmo-stp_10.42.42.5(pid=3812): Launched 16:05:53.029177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:05:53.553315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3814): Launched 16:05:53.670978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:05:53.928457 run patchelf(pid=3815): Launched 16:05:54.098612 run osmo-stp_10.42.42.5(pid=3812): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3812)] 16:05:54.227006 run osmo-stp_10.42.42.5(pid=3812): stdout: | (launched: 2022-12-13_16:05:52.857893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:54.357609 run osmo-stp_10.42.42.5(pid=3812): stderr: | [0;m[38;5;43m20221213160553025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160553026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160553026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160553026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160553027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160553027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160553027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:54.488267 run osmo-stp_10.42.42.5(pid=3812): stdout: | (launched: 2022-12-13_16:05:52.857893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:54.613094 run osmo-stp_10.42.42.5(pid=3812): stderr: | [0;m[38;5;43m20221213160553025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160553026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160553026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160553026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160553027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160553027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160553027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:54.760505 run patchelf(pid=3815): Terminating (SIGINT) 16:05:54.931391 run patchelf(pid=3815): Terminated: ok {rc=0} 16:05:55.054376 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3812): Process ended prematurely: osmo-stp_10.42.42.5(pid=3812) [trial-2391↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3812)] [trial-2391↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:05:55.063537 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 16:05:55.090533 run osmo-hlr_10.42.42.2(pid=3809): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3809)] 16:05:55.138517 run osmo-hlr_10.42.42.2(pid=3809): stdout: | (launched: 2022-12-13_16:05:51.903667) 16:05:55.188244 run osmo-hlr_10.42.42.2(pid=3809): stderr: | [0;m[1;31m20221213160552082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160552082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160552082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160552082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160552082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160552082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160552094 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160552102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160552102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160552102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:55.238105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3807): Terminating (SIGTERM) 16:05:55.278429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3811): Terminating (SIGTERM) 16:05:55.318624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3814): Terminating (SIGTERM) 16:05:55.359030 --- ParallelTerminationStrategy: PID 3807 died... 16:05:55.378002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3807): Terminated: ok {rc=0} 16:05:55.422181 --- ParallelTerminationStrategy: PID 3811 died... 16:05:55.440870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3811): Terminated: ok {rc=0} 16:05:55.485145 --- ParallelTerminationStrategy: PID 3814 died... 16:05:55.504012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3814): Terminated: ok {rc=0} 16:05:55.590102 bus /gobi_0: Setting Powered False 16:05:56.689929 bus /gobi_0: Setting Powered False 16:05:57.803744 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:05:59.060770 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:05:59.067404 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:05:59.100391 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:05:59.135278 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:05:59.188116 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:05:59.222565 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:05:59.258487 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:05:59.815783 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:05:59.821229 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:05:59.833118 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:05:59.904153 tst switch_tch_pdch.py: using LAC 34720 16:06:00.031805 tst switch_tch_pdch.py: using RAC 40 16:06:00.157401 tst switch_tch_pdch.py: using CellId 34720 16:06:00.284327 tst switch_tch_pdch.py: using BVCI 34721 16:06:00.402448 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:06:00.414026 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:06:00.425332 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:06:00.436742 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:06:00.448406 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:06:00.460085 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:06:00.471907 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:06:00.483634 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:06:00.601803 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:06:00.723409 tst switch_tch_pdch.py:51: start network... 16:06:00.962584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:01.453314 run create_hlr_db(pid=3819): Launched 16:06:01.611579 bus /gobi_6: Setting Powered False 16:06:02.672837 run create_hlr_db(pid=3819): Terminated: ok {rc=0} 16:06:03.088414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3821): Launched 16:06:03.414842 run osmo-hlr_10.42.42.2(pid=3822): Launched 16:06:03.541032 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:04.071716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3824): Launched 16:06:04.397104 run osmo-stp_10.42.42.5(pid=3825): Launched 16:06:04.520459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:06:05.050332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3827): Launched 16:06:05.176180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:06:05.450481 run patchelf(pid=3828): Launched 16:06:05.631893 run osmo-stp_10.42.42.5(pid=3825): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3825)] 16:06:05.769365 run osmo-stp_10.42.42.5(pid=3825): stdout: | (launched: 2022-12-13_16:06:04.337413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:05.908532 run osmo-stp_10.42.42.5(pid=3825): stderr: | [0;m[38;5;43m20221213160604524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160604525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160604525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160604525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160604526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160604526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160604526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:06.047968 run osmo-stp_10.42.42.5(pid=3825): stdout: | (launched: 2022-12-13_16:06:04.337413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:06.180662 run osmo-stp_10.42.42.5(pid=3825): stderr: | [0;m[38;5;43m20221213160604524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160604525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160604525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160604525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160604526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160604526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160604526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:06.337895 run patchelf(pid=3828): Terminating (SIGINT) 16:06:06.519971 run patchelf(pid=3828): Terminated: ok {rc=0} 16:06:06.651245 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3825): Process ended prematurely: osmo-stp_10.42.42.5(pid=3825) [trial-2391↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3825)] [trial-2391↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:06:06.661068 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 16:06:06.689154 run osmo-hlr_10.42.42.2(pid=3822): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3822)] 16:06:06.739707 run osmo-hlr_10.42.42.2(pid=3822): stdout: | (launched: 2022-12-13_16:06:03.355617) 16:06:06.791546 run osmo-hlr_10.42.42.2(pid=3822): stderr: | [0;m[1;31m20221213160603548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160603548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160603548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160603548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160603548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160603549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160603565 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160603574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160603574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160603574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:06.843979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3821): Terminating (SIGTERM) 16:06:06.886050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3824): Terminating (SIGTERM) 16:06:06.927806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3827): Terminating (SIGTERM) 16:06:06.970032 --- ParallelTerminationStrategy: PID 3821 died... 16:06:06.990470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3821): Terminated: ok {rc=0} 16:06:07.036677 --- ParallelTerminationStrategy: PID 3824 died... 16:06:07.056578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3824): Terminated: ok {rc=0} 16:06:07.102567 --- ParallelTerminationStrategy: PID 3827 died... 16:06:07.122407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3827): Terminated: ok {rc=0} 16:06:07.210052 bus /gobi_0: Setting Powered False 16:06:08.308457 bus /gobi_0: Setting Powered False 16:06:09.423541 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 16:06:10.681577 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:06:10.685835 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:06:10.720564 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 16:06:10.729040 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:06:10.782525 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:06:10.817624 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 16:06:10.824660 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:06:11.364659 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 16:06:11.370080 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 16:06:11.381571 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:06:11.436467 tst mo_mt_sms.py: using LAC 34721 16:06:11.556503 tst mo_mt_sms.py: using RAC 41 16:06:11.674414 tst mo_mt_sms.py: using CellId 34721 16:06:11.793145 tst mo_mt_sms.py: using BVCI 34722 16:06:11.902781 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:06:12.020633 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:06:12.137499 tst mo_mt_sms.py:9: start nitb and bts... 16:06:12.342527 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:06:12.960217 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3832): Launched 16:06:13.264329 run osmo-nitb_10.42.42.2(pid=3833): Launched 16:06:13.432689 run osmo-nitb_10.42.42.2(pid=3833): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3833)] 16:06:13.569190 run osmo-nitb_10.42.42.2(pid=3833): stdout: | (launched: 2022-12-13_16:06:13.208330) 16:06:13.706692 run osmo-nitb_10.42.42.2(pid=3833): stderr: | (launched: 2022-12-13_16:06:13.253632) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:06:13.844229 run osmo-nitb_10.42.42.2(pid=3833): stdout: | (launched: 2022-12-13_16:06:13.208330) 16:06:13.975866 run osmo-nitb_10.42.42.2(pid=3833): stderr: | (launched: 2022-12-13_16:06:13.253632) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3833): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3833) [trial-2391↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3833)] 16:06:14.378776 tst osmo-nitb_10.42.42.2(pid=3833): stdout: | (launched: 2022-12-13_16:06:13.208330) 16:06:14.501169 tst osmo-nitb_10.42.42.2(pid=3833): stderr: | (launched: 2022-12-13_16:06:13.253632) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:06:14.645600 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3833): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3833) [trial-2391↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3833)] [trial-2391↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 16:06:14.654099 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 16:06:14.660684 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3832): Terminating (SIGTERM) 16:06:14.869176 --- ParallelTerminationStrategy: PID 3832 died... 16:06:14.889558 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3832): Terminated: ok {rc=0} 16:06:14.976550 bus /sierra_3: Setting Powered False 16:06:16.079418 bus /sierra_3: Setting Powered False 16:06:17.200392 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 sms:trx-sysmocell5000 --------------------------------------------------------------------- 16:06:18.405308 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:06:18.410163 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:06:18.445145 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:06:18.473459 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:06:18.526655 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:06:18.562120 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:06:18.590385 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:06:19.138786 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 16:06:19.144291 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:19.155596 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:06:19.206011 tst mo_mt_sms.py: using LAC 34722 16:06:19.335738 tst mo_mt_sms.py: using RAC 42 16:06:19.462881 tst mo_mt_sms.py: using CellId 34722 16:06:19.590632 tst mo_mt_sms.py: using BVCI 34723 16:06:19.709020 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:19.720272 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:19.731442 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:19.742545 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:19.754242 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:19.765941 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:06:19.883160 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:06:20.004018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:20.510971 run create_hlr_db(pid=3837): Launched 16:06:20.637026 bus /sierra_2: Setting Powered False 16:06:21.702015 run create_hlr_db(pid=3837): Terminated: ok {rc=0} 16:06:22.140050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3839): Launched 16:06:22.447477 run osmo-hlr_10.42.42.2(pid=3840): Launched 16:06:22.564365 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:23.088730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3842): Launched 16:06:23.393013 run osmo-stp_10.42.42.5(pid=3843): Launched 16:06:23.508284 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:24.057210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3845): Launched 16:06:24.361851 run osmo-msc_10.42.42.6(pid=3846): Launched 16:06:24.531694 run osmo-stp_10.42.42.5(pid=3843): ERR: Terminated: ERROR {rc=1} [trial-2391↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3843)] 16:06:24.659473 run osmo-stp_10.42.42.5(pid=3843): stdout: | (launched: 2022-12-13_16:06:23.336876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:24.787497 run osmo-stp_10.42.42.5(pid=3843): stderr: | [0;m[38;5;43m20221213160623505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160623505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160623505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160623506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160623506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160623506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160623506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:24.914204 run osmo-stp_10.42.42.5(pid=3843): stdout: | (launched: 2022-12-13_16:06:23.336876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:25.035182 run osmo-stp_10.42.42.5(pid=3843): stderr: | [0;m[38;5;43m20221213160623505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160623505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160623505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160623506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160623506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160623506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160623506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:25.180103 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3843): Process ended prematurely: osmo-stp_10.42.42.5(pid=3843) [trial-2391↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3843)] [trial-2391↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 16:06:25.188770 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 16:06:25.215062 run osmo-hlr_10.42.42.2(pid=3840): ERR: Terminated: ERROR {rc=237} [trial-2391↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3840)] 16:06:25.263098 run osmo-hlr_10.42.42.2(pid=3840): stdout: | (launched: 2022-12-13_16:06:22.391363) 16:06:25.313210 run osmo-hlr_10.42.42.2(pid=3840): stderr: | [0;m[1;31m20221213160622563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160622563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160622564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160622564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160622564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160622564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160622576 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160622587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160622587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160622587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:25.382284 run osmo-msc_10.42.42.6(pid=3846): ERR: Terminated: ERROR {rc=2} [trial-2391↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3846)] 16:06:25.429942 run osmo-msc_10.42.42.6(pid=3846): stdout: | (launched: 2022-12-13_16:06:24.305782) 16:06:25.479360 run osmo-msc_10.42.42.6(pid=3846): stderr: | [0;m[38;5;43m20221213160624576 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160624576 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6d51e33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160624576 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160624576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160624576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160624577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160624579 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160624580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160624580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160624580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:25.529497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3839): Terminating (SIGTERM) 16:06:25.569660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3842): Terminating (SIGTERM) 16:06:25.610036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3845): Terminating (SIGTERM) 16:06:25.650300 --- ParallelTerminationStrategy: PID 3839 died... 16:06:25.669693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3839): Terminated: ok {rc=0} 16:06:25.713700 --- ParallelTerminationStrategy: PID 3842 died... 16:06:25.732470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3842): Terminated: ok {rc=0} 16:06:25.776360 --- ParallelTerminationStrategy: PID 3845 died... 16:06:25.795262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3845): Terminated: ok {rc=0} 16:06:25.882644 bus /sierra_3: Setting Powered False 16:06:26.983956 bus /sierra_3: Setting Powered False 16:06:28.103483 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 16:06:29.337243 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:06:29.342302 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:06:29.377598 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 16:06:29.386885 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 16:06:29.422698 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:06:29.458115 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 16:06:29.465612 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 16:06:29.986722 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2391 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 16:06:29.991878 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 16:06:30.003326 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:06:30.055139 tst assert_extension.py: using LAC 34723 16:06:30.181944 tst assert_extension.py: using RAC 43 16:06:30.310853 tst assert_extension.py: using CellId 34723 16:06:30.438215 tst assert_extension.py: using BVCI 34724 16:06:30.556685 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 16:06:30.673274 tst assert_extension.py:10: start nitb and bts... 16:06:30.878967 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:06:31.517749 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3851): Launched 16:06:31.879060 run osmo-nitb_10.42.42.2(pid=3852): Launched 16:06:32.083800 run osmo-nitb_10.42.42.2(pid=3852): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3852)] 16:06:32.234774 run osmo-nitb_10.42.42.2(pid=3852): stdout: | (launched: 2022-12-13_16:06:31.817895) 16:06:32.382948 run osmo-nitb_10.42.42.2(pid=3852): stderr: | (launched: 2022-12-13_16:06:31.868644) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:06:32.531525 run osmo-nitb_10.42.42.2(pid=3852): stdout: | (launched: 2022-12-13_16:06:31.817895) 16:06:32.673403 run osmo-nitb_10.42.42.2(pid=3852): stderr: | (launched: 2022-12-13_16:06:31.868644) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3852): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3852) [trial-2391↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3852)] 16:06:33.025444 tst osmo-nitb_10.42.42.2(pid=3852): stdout: | (launched: 2022-12-13_16:06:31.817895) 16:06:33.157576 tst osmo-nitb_10.42.42.2(pid=3852): stderr: | (launched: 2022-12-13_16:06:31.868644) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:06:33.313974 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3852): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3852) [trial-2391↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3852)] [trial-2391↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 16:06:33.323414 tst assert_extension.py:12: Test FAILED (3.3 sec) 16:06:33.330969 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3851): Terminating (SIGTERM) 16:06:33.543165 --- ParallelTerminationStrategy: PID 3851 died... 16:06:33.565399 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3851): Terminated: ok {rc=0} 16:06:33.657178 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 16:06:34.837486 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:06:34.841832 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:06:34.876483 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:06:34.906683 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 16:06:34.943479 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:06:34.979224 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:06:35.007460 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 16:06:35.541405 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2391 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 16:06:35.547410 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:35.559285 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:06:35.613108 tst assert_extension.py: using LAC 34724 16:06:35.741580 tst assert_extension.py: using RAC 44 16:06:35.861094 tst assert_extension.py: using CellId 34724 16:06:35.981237 tst assert_extension.py: using BVCI 34725 16:06:36.091941 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:36.103013 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:36.113914 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:36.124675 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:36.135303 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:06:36.145875 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 16:06:36.266858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:36.770032 run create_hlr_db(pid=3857): Launched 16:06:36.896232 bus /sierra_2: Setting Powered False 16:06:37.960695 run create_hlr_db(pid=3857): Terminated: ok {rc=0} 16:06:38.396088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3859): Launched 16:06:38.703176 run osmo-hlr_10.42.42.2(pid=3860): Launched 16:06:38.819120 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:39.444863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3862): Launched 16:06:39.747652 run osmo-stp_10.42.42.5(pid=3863): Launched 16:06:39.862039 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:40.406936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3865): Launched 16:06:40.708523 run osmo-msc_10.42.42.6(pid=3866): Launched 16:06:40.876516 run osmo-stp_10.42.42.5(pid=3863): ERR: Terminated: ERROR {rc=1} [trial-2391↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3863)] 16:06:41.003788 run osmo-stp_10.42.42.5(pid=3863): stdout: | (launched: 2022-12-13_16:06:39.691544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:41.130751 run osmo-stp_10.42.42.5(pid=3863): stderr: | [0;m[38;5;43m20221213160639860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160639861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160639861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160639861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160639862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160639862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160639862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:41.255456 run osmo-stp_10.42.42.5(pid=3863): stdout: | (launched: 2022-12-13_16:06:39.691544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:41.374954 run osmo-stp_10.42.42.5(pid=3863): stderr: | [0;m[38;5;43m20221213160639860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160639861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160639861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160639861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160639862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160639862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160639862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:41.518051 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3863): Process ended prematurely: osmo-stp_10.42.42.5(pid=3863) [trial-2391↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3863)] [trial-2391↪ussd:trx-sysmocell5000↪assert_extension.py:17] 16:06:41.526495 tst assert_extension.py:17: Test FAILED (6.0 sec) 16:06:41.552403 run osmo-hlr_10.42.42.2(pid=3860): ERR: Terminated: ERROR {rc=237} [trial-2391↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3860)] 16:06:41.599999 run osmo-hlr_10.42.42.2(pid=3860): stdout: | (launched: 2022-12-13_16:06:38.646116) 16:06:41.649337 run osmo-hlr_10.42.42.2(pid=3860): stderr: | [0;m[1;31m20221213160638820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160638820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160638820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160638820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160638820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160638821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160638832 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160638841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160638841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160638841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:41.717790 run osmo-msc_10.42.42.6(pid=3866): ERR: Terminated: ERROR {rc=2} [trial-2391↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3866)] 16:06:41.765397 run osmo-msc_10.42.42.6(pid=3866): stdout: | (launched: 2022-12-13_16:06:40.652874) 16:06:41.814536 run osmo-msc_10.42.42.6(pid=3866): stderr: | [0;m[38;5;43m20221213160640922 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160640922 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f878653dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160640922 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160640923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160640923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160640923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160640925 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160640925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160640925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160640925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:41.864367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3859): Terminating (SIGTERM) 16:06:41.904052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3862): Terminating (SIGTERM) 16:06:41.943685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3865): Terminating (SIGTERM) 16:06:41.983489 --- ParallelTerminationStrategy: PID 3859 died... 16:06:42.002941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3859): Terminated: ok {rc=0} 16:06:42.046667 --- ParallelTerminationStrategy: PID 3862 died... 16:06:42.065150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3862): Terminated: ok {rc=0} 16:06:42.108714 --- ParallelTerminationStrategy: PID 3865 died... 16:06:42.127247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3865): Terminated: ok {rc=0} 16:06:42.212417 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:06:43.427716 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:06:43.434750 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:06:43.468577 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:06:43.495687 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:06:43.547224 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:06:43.582591 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:06:43.610521 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:06:44.161376 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:06:44.210864 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:44.222502 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:06:44.291643 tst mo_mt_call.py: using LAC 34725 16:06:44.414713 tst mo_mt_call.py: using RAC 45 16:06:44.535895 tst mo_mt_call.py: using CellId 34725 16:06:44.655181 tst mo_mt_call.py: using BVCI 34726 16:06:44.766725 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:44.778054 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:44.790030 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:44.801235 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:44.812439 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:44.823680 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:06:44.939384 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:06:45.060753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:45.564849 run create_hlr_db(pid=3872): Launched 16:06:45.691040 bus /sierra_2: Setting Powered False 16:06:46.772712 run create_hlr_db(pid=3872): Terminated: ok {rc=0} 16:06:47.240886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3874): Launched 16:06:47.561021 run osmo-hlr_10.42.42.2(pid=3875): Launched 16:06:47.679320 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:48.216899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3877): Launched 16:06:48.523274 run osmo-stp_10.42.42.5(pid=3878): Launched 16:06:48.641621 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:49.194093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3880): Launched 16:06:49.502103 run osmo-msc_10.42.42.6(pid=3881): Launched 16:06:49.675737 run osmo-stp_10.42.42.5(pid=3878): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3878)] 16:06:49.804272 run osmo-stp_10.42.42.5(pid=3878): stdout: | (launched: 2022-12-13_16:06:48.467169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:49.932752 run osmo-stp_10.42.42.5(pid=3878): stderr: | [0;m[38;5;43m20221213160648637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160648637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160648637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160648638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160648638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160648638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160648638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:50.059623 run osmo-stp_10.42.42.5(pid=3878): stdout: | (launched: 2022-12-13_16:06:48.467169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:50.180337 run osmo-stp_10.42.42.5(pid=3878): stderr: | [0;m[38;5;43m20221213160648637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160648637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160648637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160648638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160648638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160648638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160648638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:50.326291 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3878): Process ended prematurely: osmo-stp_10.42.42.5(pid=3878) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3878)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:06:50.335383 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:06:50.362029 run osmo-hlr_10.42.42.2(pid=3875): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3875)] 16:06:50.409989 run osmo-hlr_10.42.42.2(pid=3875): stdout: | (launched: 2022-12-13_16:06:47.504778) 16:06:50.459548 run osmo-hlr_10.42.42.2(pid=3875): stderr: | [0;m[1;31m20221213160647679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160647679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160647679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160647679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160647679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160647679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160647691 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160647699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160647700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160647700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:50.528694 run osmo-msc_10.42.42.6(pid=3881): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3881)] 16:06:50.576657 run osmo-msc_10.42.42.6(pid=3881): stdout: | (launched: 2022-12-13_16:06:49.445994) 16:06:50.625802 run osmo-msc_10.42.42.6(pid=3881): stderr: | [0;m[38;5;43m20221213160649717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160649717 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcaa82ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160649717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160649717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160649717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160649718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160649719 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160649720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160649720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160649720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:50.675378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3874): Terminating (SIGTERM) 16:06:50.714944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3877): Terminating (SIGTERM) 16:06:50.754706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3880): Terminating (SIGTERM) 16:06:50.794846 --- ParallelTerminationStrategy: PID 3874 died... 16:06:50.813994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3874): Terminated: ok {rc=0} 16:06:50.858004 --- ParallelTerminationStrategy: PID 3877 died... 16:06:50.876549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3877): Terminated: ok {rc=0} 16:06:50.920281 --- ParallelTerminationStrategy: PID 3880 died... 16:06:50.938955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3880): Terminated: ok {rc=0} 16:06:51.022227 bus /sierra_3: Setting Powered False 16:06:52.121078 bus /sierra_3: Setting Powered False 16:06:53.237412 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:06:54.387378 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:54.399992 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:06:54.473447 tst mo_mt_call_osmux.py: using LAC 34726 16:06:54.602986 tst mo_mt_call_osmux.py: using RAC 46 16:06:54.730382 tst mo_mt_call_osmux.py: using CellId 34726 16:06:54.859500 tst mo_mt_call_osmux.py: using BVCI 34727 16:06:54.978493 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:54.990824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:55.002416 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:55.014045 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:55.026127 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:06:55.038086 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:06:55.155885 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:06:55.277996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:55.784176 run create_hlr_db(pid=3883): Launched 16:06:55.908609 bus /sierra_2: Setting Powered False 16:06:56.973528 run create_hlr_db(pid=3883): Terminated: ok {rc=0} 16:06:57.426923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3885): Launched 16:06:57.757143 run osmo-hlr_10.42.42.2(pid=3886): Launched 16:06:57.882622 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:58.448628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3888): Launched 16:06:58.777241 run osmo-stp_10.42.42.5(pid=3889): Launched 16:06:58.903427 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:59.493983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3891): Launched 16:06:59.822416 run osmo-msc_10.42.42.6(pid=3892): Launched 16:07:00.007240 run osmo-stp_10.42.42.5(pid=3889): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3889)] 16:07:00.145569 run osmo-stp_10.42.42.5(pid=3889): stdout: | (launched: 2022-12-13_16:06:58.717381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:00.284439 run osmo-stp_10.42.42.5(pid=3889): stderr: | [0;m[38;5;43m20221213160658906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160658906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160658907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160658907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160658908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160658908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160658908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:00.421276 run osmo-stp_10.42.42.5(pid=3889): stdout: | (launched: 2022-12-13_16:06:58.717381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:00.551526 run osmo-stp_10.42.42.5(pid=3889): stderr: | [0;m[38;5;43m20221213160658906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160658906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160658907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160658907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160658908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160658908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160658908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:00.707465 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3889): Process ended prematurely: osmo-stp_10.42.42.5(pid=3889) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3889)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:07:00.717342 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:07:00.745176 run osmo-hlr_10.42.42.2(pid=3886): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3886)] 16:07:00.796254 run osmo-hlr_10.42.42.2(pid=3886): stdout: | (launched: 2022-12-13_16:06:57.697669) 16:07:00.860168 run osmo-hlr_10.42.42.2(pid=3886): stderr: | [0;m[1;31m20221213160657891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160657891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160657891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160657891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160657891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160657891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160657904 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160657912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160657912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160657912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:00.947936 run osmo-msc_10.42.42.6(pid=3892): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3892)] 16:07:00.999752 run osmo-msc_10.42.42.6(pid=3892): stdout: | (launched: 2022-12-13_16:06:59.762577) 16:07:01.057601 run osmo-msc_10.42.42.6(pid=3892): stderr: | [0;m[38;5;43m20221213160700082 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160700082 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5bb7e7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160700082 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160700082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160700083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160700083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160700084 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160700085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160700085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160700085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:01.112511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3885): Terminating (SIGTERM) 16:07:01.156244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3888): Terminating (SIGTERM) 16:07:01.202047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3891): Terminating (SIGTERM) 16:07:01.246746 --- ParallelTerminationStrategy: PID 3885 died... 16:07:01.268602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3885): Terminated: ok {rc=0} 16:07:01.317150 --- ParallelTerminationStrategy: PID 3888 died... 16:07:01.340808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3888): Terminated: ok {rc=0} 16:07:01.389311 --- ParallelTerminationStrategy: PID 3891 died... 16:07:01.410733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3891): Terminated: ok {rc=0} 16:07:01.502404 bus /sierra_3: Setting Powered False 16:07:02.603849 bus /sierra_3: Setting Powered False 16:07:03.722589 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:07:04.977704 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:07:04.986105 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:07:05.020268 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:07:05.046949 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:07:05.099822 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:07:05.134792 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:07:05.162553 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:07:05.711516 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:07:05.760302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:05.772214 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:07:05.842722 tst mo_mt_call.py: using LAC 34727 16:07:05.964590 tst mo_mt_call.py: using RAC 47 16:07:06.086463 tst mo_mt_call.py: using CellId 34727 16:07:06.208936 tst mo_mt_call.py: using BVCI 34728 16:07:06.321145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:06.332361 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:06.343679 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:06.354804 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:06.366001 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:06.377160 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:07:06.494014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:07:06.613125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:07.089175 run create_hlr_db(pid=3897): Launched 16:07:07.215874 bus /sierra_2: Setting Powered False 16:07:08.276086 run create_hlr_db(pid=3897): Terminated: ok {rc=0} 16:07:08.723804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3899): Launched 16:07:09.052105 run osmo-hlr_10.42.42.2(pid=3900): Launched 16:07:09.177340 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:09.743327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3902): Launched 16:07:10.072626 run osmo-stp_10.42.42.5(pid=3903): Launched 16:07:10.197493 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:10.792264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3905): Launched 16:07:11.122114 run osmo-msc_10.42.42.6(pid=3906): Launched 16:07:11.307148 run osmo-stp_10.42.42.5(pid=3903): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3903)] 16:07:11.445988 run osmo-stp_10.42.42.5(pid=3903): stdout: | (launched: 2022-12-13_16:07:10.012100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:11.585699 run osmo-stp_10.42.42.5(pid=3903): stderr: | [0;m[38;5;43m20221213160710202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160710202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160710202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160710203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160710203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160710203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160710203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:11.722470 run osmo-stp_10.42.42.5(pid=3903): stdout: | (launched: 2022-12-13_16:07:10.012100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:11.852588 run osmo-stp_10.42.42.5(pid=3903): stderr: | [0;m[38;5;43m20221213160710202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160710202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160710202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160710203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160710203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160710203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160710203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:12.008533 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3903): Process ended prematurely: osmo-stp_10.42.42.5(pid=3903) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3903)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:07:12.018377 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:07:12.046305 run osmo-hlr_10.42.42.2(pid=3900): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3900)] 16:07:12.097501 run osmo-hlr_10.42.42.2(pid=3900): stdout: | (launched: 2022-12-13_16:07:08.992045) 16:07:12.149690 run osmo-hlr_10.42.42.2(pid=3900): stderr: | [0;m[1;31m20221213160709187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160709187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160709187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160709187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160709187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160709187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160709198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160709207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160709207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160709207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:12.222860 run osmo-msc_10.42.42.6(pid=3906): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3906)] 16:07:12.273220 run osmo-msc_10.42.42.6(pid=3906): stdout: | (launched: 2022-12-13_16:07:11.061961) 16:07:12.325513 run osmo-msc_10.42.42.6(pid=3906): stderr: | [0;m[38;5;43m20221213160711381 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160711381 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f16a9601c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160711381 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160711382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160711382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160711382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160711384 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160711384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160711384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160711384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:12.378115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3899): Terminating (SIGTERM) 16:07:12.420529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3902): Terminating (SIGTERM) 16:07:12.463472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3905): Terminating (SIGTERM) 16:07:12.506828 --- ParallelTerminationStrategy: PID 3899 died... 16:07:12.527703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3899): Terminated: ok {rc=0} 16:07:12.574473 --- ParallelTerminationStrategy: PID 3902 died... 16:07:12.594493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3902): Terminated: ok {rc=0} 16:07:12.640616 --- ParallelTerminationStrategy: PID 3905 died... 16:07:12.660542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3905): Terminated: ok {rc=0} 16:07:12.750081 bus /sierra_3: Setting Powered False 16:07:13.848539 bus /sierra_3: Setting Powered False 16:07:14.965628 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:07:16.138847 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:16.153181 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:07:16.228246 tst mo_mt_call_osmux.py: using LAC 34728 16:07:16.385545 tst mo_mt_call_osmux.py: using RAC 48 16:07:16.542927 tst mo_mt_call_osmux.py: using CellId 34728 16:07:16.700869 tst mo_mt_call_osmux.py: using BVCI 34729 16:07:16.819812 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:16.831624 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:16.843283 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:16.855054 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:16.867469 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:07:16.880754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:07:17.006464 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:07:17.126595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:17.639099 run create_hlr_db(pid=3908): Launched 16:07:17.764376 bus /sierra_2: Setting Powered False 16:07:18.825943 run create_hlr_db(pid=3908): Terminated: ok {rc=0} 16:07:19.283263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3910): Launched 16:07:19.612838 run osmo-hlr_10.42.42.2(pid=3911): Launched 16:07:19.738323 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:20.304646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3913): Launched 16:07:20.634513 run osmo-stp_10.42.42.5(pid=3914): Launched 16:07:20.760302 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:21.352539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3916): Launched 16:07:21.683778 run osmo-msc_10.42.42.6(pid=3917): Launched 16:07:21.867426 run osmo-stp_10.42.42.5(pid=3914): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3914)] 16:07:22.005777 run osmo-stp_10.42.42.5(pid=3914): stdout: | (launched: 2022-12-13_16:07:20.573851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:22.145349 run osmo-stp_10.42.42.5(pid=3914): stderr: | [0;m[38;5;43m20221213160720762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160720763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160720763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160720763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160720764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160720764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160720764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:22.282952 run osmo-stp_10.42.42.5(pid=3914): stdout: | (launched: 2022-12-13_16:07:20.573851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:22.414014 run osmo-stp_10.42.42.5(pid=3914): stderr: | [0;m[38;5;43m20221213160720762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160720763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160720763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160720763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160720764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160720764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160720764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:22.571367 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3914): Process ended prematurely: osmo-stp_10.42.42.5(pid=3914) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3914)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:07:22.581544 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:07:22.609505 run osmo-hlr_10.42.42.2(pid=3911): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3911)] 16:07:22.660216 run osmo-hlr_10.42.42.2(pid=3911): stdout: | (launched: 2022-12-13_16:07:19.552588) 16:07:22.712245 run osmo-hlr_10.42.42.2(pid=3911): stderr: | [0;m[1;31m20221213160719748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160719748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160719748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160719748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160719748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160719748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160719761 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160719770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160719770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160719770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:22.785340 run osmo-msc_10.42.42.6(pid=3917): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3917)] 16:07:22.835629 run osmo-msc_10.42.42.6(pid=3917): stdout: | (launched: 2022-12-13_16:07:21.623569) 16:07:22.887700 run osmo-msc_10.42.42.6(pid=3917): stderr: | [0;m[38;5;43m20221213160721944 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160721944 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90571acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160721945 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160721945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160721945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160721945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160721947 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160721947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160721947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160721947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:22.940235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3910): Terminating (SIGTERM) 16:07:22.982566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3913): Terminating (SIGTERM) 16:07:23.025593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3916): Terminating (SIGTERM) 16:07:23.068159 --- ParallelTerminationStrategy: PID 3910 died... 16:07:23.088558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3910): Terminated: ok {rc=0} 16:07:23.135320 --- ParallelTerminationStrategy: PID 3913 died... 16:07:23.155181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3913): Terminated: ok {rc=0} 16:07:23.201271 --- ParallelTerminationStrategy: PID 3916 died... 16:07:23.220938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3916): Terminated: ok {rc=0} 16:07:23.309803 bus /sierra_3: Setting Powered False 16:07:24.408404 bus /sierra_3: Setting Powered False 16:07:25.527474 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:07:26.785239 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:07:26.792812 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:07:26.829144 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:07:26.857010 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:07:26.912470 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:07:26.947822 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:07:26.976047 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:07:27.529759 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:07:27.578973 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:27.590783 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:07:27.659933 tst mo_mt_call.py: using LAC 34729 16:07:27.779332 tst mo_mt_call.py: using RAC 49 16:07:27.900549 tst mo_mt_call.py: using CellId 34729 16:07:28.019889 tst mo_mt_call.py: using BVCI 34730 16:07:28.131181 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:28.142600 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:28.153864 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:28.164904 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:28.176209 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:28.187284 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:07:28.303914 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:07:28.424868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:28.935087 run create_hlr_db(pid=3922): Launched 16:07:29.063559 bus /sierra_2: Setting Powered False 16:07:30.124306 run create_hlr_db(pid=3922): Terminated: ok {rc=0} 16:07:30.563729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3924): Launched 16:07:30.895865 run osmo-hlr_10.42.42.2(pid=3925): Launched 16:07:31.116326 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:31.810657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3927): Launched 16:07:32.141587 run osmo-stp_10.42.42.5(pid=3928): Launched 16:07:32.313258 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:32.934970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3930): Launched 16:07:33.244398 run osmo-msc_10.42.42.6(pid=3931): Launched 16:07:33.415464 run osmo-stp_10.42.42.5(pid=3928): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3928)] 16:07:33.543942 run osmo-stp_10.42.42.5(pid=3928): stdout: | (launched: 2022-12-13_16:07:32.078819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:33.673651 run osmo-stp_10.42.42.5(pid=3928): stderr: | [0;m[38;5;43m20221213160732408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160732408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160732409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160732409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160732409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160732409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160732410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:33.801402 run osmo-stp_10.42.42.5(pid=3928): stdout: | (launched: 2022-12-13_16:07:32.078819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:33.923008 run osmo-stp_10.42.42.5(pid=3928): stderr: | [0;m[38;5;43m20221213160732408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160732408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160732409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160732409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160732409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160732409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160732410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:34.069093 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3928): Process ended prematurely: osmo-stp_10.42.42.5(pid=3928) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3928)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:07:34.078110 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:07:34.104551 run osmo-hlr_10.42.42.2(pid=3925): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3925)] 16:07:34.152214 run osmo-hlr_10.42.42.2(pid=3925): stdout: | (launched: 2022-12-13_16:07:30.816499) 16:07:34.201717 run osmo-hlr_10.42.42.2(pid=3925): stderr: | [0;m[1;31m20221213160731108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160731109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160731109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160731109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160731109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160731109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160731127 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160731139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160731139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160731140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:34.271189 run osmo-msc_10.42.42.6(pid=3931): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3931)] 16:07:34.319109 run osmo-msc_10.42.42.6(pid=3931): stdout: | (launched: 2022-12-13_16:07:33.187402) 16:07:34.368532 run osmo-msc_10.42.42.6(pid=3931): stderr: | [0;m[38;5;43m20221213160733460 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160733460 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f857905bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160733460 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160733460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160733460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160733461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160733462 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160733463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160733463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160733463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:34.418150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3924): Terminating (SIGTERM) 16:07:34.458276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3927): Terminating (SIGTERM) 16:07:34.498219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3930): Terminating (SIGTERM) 16:07:34.538601 --- ParallelTerminationStrategy: PID 3924 died... 16:07:34.558005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3924): Terminated: ok {rc=0} 16:07:34.602170 --- ParallelTerminationStrategy: PID 3927 died... 16:07:34.620742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3927): Terminated: ok {rc=0} 16:07:34.664695 --- ParallelTerminationStrategy: PID 3930 died... 16:07:34.683966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3930): Terminated: ok {rc=0} 16:07:34.768446 bus /sierra_3: Setting Powered False 16:07:35.867152 bus /sierra_3: Setting Powered False 16:07:36.987158 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:07:38.133976 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:38.146065 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:07:38.217392 tst mo_mt_call_osmux.py: using LAC 34730 16:07:38.340741 tst mo_mt_call_osmux.py: using RAC 50 16:07:38.463109 tst mo_mt_call_osmux.py: using CellId 34730 16:07:38.584660 tst mo_mt_call_osmux.py: using BVCI 34731 16:07:38.706365 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:38.718414 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:38.730373 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:38.742412 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:38.754683 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:07:38.766901 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:07:38.885710 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:07:39.004570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:39.483444 run create_hlr_db(pid=3933): Launched 16:07:39.610947 bus /sierra_2: Setting Powered False 16:07:40.672454 run create_hlr_db(pid=3933): Terminated: ok {rc=0} 16:07:41.103654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3935): Launched 16:07:41.414462 run osmo-hlr_10.42.42.2(pid=3936): Launched 16:07:41.534299 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:42.066072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3938): Launched 16:07:42.376407 run osmo-stp_10.42.42.5(pid=3939): Launched 16:07:42.493956 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:43.051980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3941): Launched 16:07:43.362294 run osmo-msc_10.42.42.6(pid=3942): Launched 16:07:43.536825 run osmo-stp_10.42.42.5(pid=3939): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3939)] 16:07:43.666726 run osmo-stp_10.42.42.5(pid=3939): stdout: | (launched: 2022-12-13_16:07:42.319582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:43.796126 run osmo-stp_10.42.42.5(pid=3939): stderr: | [0;m[38;5;43m20221213160742488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160742489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160742489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160742489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160742490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160742490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160742490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:43.924367 run osmo-stp_10.42.42.5(pid=3939): stdout: | (launched: 2022-12-13_16:07:42.319582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:44.046900 run osmo-stp_10.42.42.5(pid=3939): stderr: | [0;m[38;5;43m20221213160742488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160742489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160742489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160742489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160742490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160742490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160742490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:44.193349 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3939): Process ended prematurely: osmo-stp_10.42.42.5(pid=3939) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3939)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:07:44.202333 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:07:44.228906 run osmo-hlr_10.42.42.2(pid=3936): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3936)] 16:07:44.276652 run osmo-hlr_10.42.42.2(pid=3936): stdout: | (launched: 2022-12-13_16:07:41.357220) 16:07:44.326035 run osmo-hlr_10.42.42.2(pid=3936): stderr: | [0;m[1;31m20221213160741531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160741532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160741532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160741532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160741532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160741532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160741544 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160741552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160741553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160741553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:44.395220 run osmo-msc_10.42.42.6(pid=3942): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3942)] 16:07:44.442688 run osmo-msc_10.42.42.6(pid=3942): stdout: | (launched: 2022-12-13_16:07:43.305090) 16:07:44.491984 run osmo-msc_10.42.42.6(pid=3942): stderr: | [0;m[38;5;43m20221213160743577 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160743577 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f407c907c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160743578 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160743578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160743578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160743578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160743581 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160743581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160743582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160743582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:44.541813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3935): Terminating (SIGTERM) 16:07:44.581501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3938): Terminating (SIGTERM) 16:07:44.621777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3941): Terminating (SIGTERM) 16:07:44.661884 --- ParallelTerminationStrategy: PID 3935 died... 16:07:44.681047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3935): Terminated: ok {rc=0} 16:07:44.724811 --- ParallelTerminationStrategy: PID 3938 died... 16:07:44.743998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3938): Terminated: ok {rc=0} 16:07:44.788409 --- ParallelTerminationStrategy: PID 3941 died... 16:07:44.807106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3941): Terminated: ok {rc=0} 16:07:44.890595 bus /sierra_3: Setting Powered False 16:07:45.990577 bus /sierra_3: Setting Powered False 16:07:47.106276 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:07:48.364572 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:07:48.372178 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:07:48.408018 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:07:48.436192 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:07:48.496540 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:07:48.531611 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:07:48.560015 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:07:49.108568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:07:49.158474 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:07:49.169984 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:07:49.239485 tst mo_mt_call.py: using LAC 34731 16:07:49.361424 tst mo_mt_call.py: using RAC 51 16:07:49.480274 tst mo_mt_call.py: using CellId 34731 16:07:49.599621 tst mo_mt_call.py: using BVCI 34732 16:07:49.712204 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:07:49.723446 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:07:49.734600 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:07:49.745706 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:07:49.757151 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:07:49.768326 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:07:49.889473 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:07:50.007338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:50.484231 run create_hlr_db(pid=3947): Launched 16:07:50.610613 bus /sierra_2: Setting Powered False 16:07:51.671823 run create_hlr_db(pid=3947): Terminated: ok {rc=0} 16:07:52.121744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3949): Launched 16:07:52.451560 run osmo-hlr_10.42.42.2(pid=3950): Launched 16:07:52.578131 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:53.145212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3952): Launched 16:07:53.475424 run osmo-stp_10.42.42.5(pid=3953): Launched 16:07:53.603550 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:54.198262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3955): Launched 16:07:54.530073 run osmo-msc_10.42.42.6(pid=3956): Launched 16:07:54.714620 run osmo-stp_10.42.42.5(pid=3953): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3953)] 16:07:54.853565 run osmo-stp_10.42.42.5(pid=3953): stdout: | (launched: 2022-12-13_16:07:53.415465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:54.993445 run osmo-stp_10.42.42.5(pid=3953): stderr: | [0;m[38;5;43m20221213160753607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160753607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160753607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160753607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160753608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160753608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160753608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:55.132111 run osmo-stp_10.42.42.5(pid=3953): stdout: | (launched: 2022-12-13_16:07:53.415465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:55.263143 run osmo-stp_10.42.42.5(pid=3953): stderr: | [0;m[38;5;43m20221213160753607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160753607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160753607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160753607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160753608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160753608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160753608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:55.419855 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3953): Process ended prematurely: osmo-stp_10.42.42.5(pid=3953) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3953)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:07:55.429629 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:07:55.457483 run osmo-hlr_10.42.42.2(pid=3950): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3950)] 16:07:55.508425 run osmo-hlr_10.42.42.2(pid=3950): stdout: | (launched: 2022-12-13_16:07:52.390896) 16:07:55.560801 run osmo-hlr_10.42.42.2(pid=3950): stderr: | [0;m[1;31m20221213160752585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160752585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160752586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160752586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160752586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160752586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160752598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160752607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160752607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160752607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:55.633679 run osmo-msc_10.42.42.6(pid=3956): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3956)] 16:07:55.683507 run osmo-msc_10.42.42.6(pid=3956): stdout: | (launched: 2022-12-13_16:07:54.469283) 16:07:55.735319 run osmo-msc_10.42.42.6(pid=3956): stderr: | [0;m[38;5;43m20221213160754791 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160754791 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff77f02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160754791 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160754791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160754792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160754792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160754794 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160754794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160754794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160754794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:55.787496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3949): Terminating (SIGTERM) 16:07:55.829797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3952): Terminating (SIGTERM) 16:07:55.872109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3955): Terminating (SIGTERM) 16:07:55.915014 --- ParallelTerminationStrategy: PID 3949 died... 16:07:55.935652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3949): Terminated: ok {rc=0} 16:07:55.982036 --- ParallelTerminationStrategy: PID 3952 died... 16:07:56.002208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3952): Terminated: ok {rc=0} 16:07:56.048445 --- ParallelTerminationStrategy: PID 3955 died... 16:07:56.068281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3955): Terminated: ok {rc=0} 16:07:56.157687 bus /sierra_3: Setting Powered False 16:07:57.256250 bus /sierra_3: Setting Powered False 16:07:58.372779 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:07:59.522374 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:07:59.534857 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:07:59.608669 tst mo_mt_call_osmux.py: using LAC 34732 16:07:59.730613 tst mo_mt_call_osmux.py: using RAC 52 16:07:59.852778 tst mo_mt_call_osmux.py: using CellId 34732 16:07:59.975800 tst mo_mt_call_osmux.py: using BVCI 34733 16:08:00.089141 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:08:00.100517 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:08:00.111945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:08:00.123257 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:08:00.134587 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:08:00.145890 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:08:00.263436 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:08:00.386523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:00.893829 run create_hlr_db(pid=3958): Launched 16:08:01.054566 bus /sierra_2: Setting Powered False 16:08:02.135116 run create_hlr_db(pid=3958): Terminated: ok {rc=0} 16:08:02.577488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3960): Launched 16:08:02.887003 run osmo-hlr_10.42.42.2(pid=3961): Launched 16:08:03.005352 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:03.539304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3963): Launched 16:08:03.848780 run osmo-stp_10.42.42.5(pid=3964): Launched 16:08:03.966203 run osmo-msc_10.42.42.6: Starting osmo-msc 16:08:04.524720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3966): Launched 16:08:04.833702 run osmo-msc_10.42.42.6(pid=3967): Launched 16:08:05.006690 run osmo-stp_10.42.42.5(pid=3964): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3964)] 16:08:05.135934 run osmo-stp_10.42.42.5(pid=3964): stdout: | (launched: 2022-12-13_16:08:03.791714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:05.266296 run osmo-stp_10.42.42.5(pid=3964): stderr: | [0;m[38;5;43m20221213160803960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160803961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160803961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160803961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160803962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160803962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160803962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:05.394308 run osmo-stp_10.42.42.5(pid=3964): stdout: | (launched: 2022-12-13_16:08:03.791714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:05.516058 run osmo-stp_10.42.42.5(pid=3964): stderr: | [0;m[38;5;43m20221213160803960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160803961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160803961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160803961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160803962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160803962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160803962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:05.662277 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3964): Process ended prematurely: osmo-stp_10.42.42.5(pid=3964) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3964)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:08:05.671527 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:08:05.698270 run osmo-hlr_10.42.42.2(pid=3961): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3961)] 16:08:05.745981 run osmo-hlr_10.42.42.2(pid=3961): stdout: | (launched: 2022-12-13_16:08:02.829802) 16:08:05.795271 run osmo-hlr_10.42.42.2(pid=3961): stderr: | [0;m[1;31m20221213160803005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160803005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160803005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160803005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160803005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160803005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160803018 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160803026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160803026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160803026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:05.864284 run osmo-msc_10.42.42.6(pid=3967): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3967)] 16:08:05.911612 run osmo-msc_10.42.42.6(pid=3967): stdout: | (launched: 2022-12-13_16:08:04.776613) 16:08:05.961325 run osmo-msc_10.42.42.6(pid=3967): stderr: | [0;m[38;5;43m20221213160805047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160805047 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f099a782c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160805047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160805047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160805047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160805048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160805049 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160805050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160805050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160805050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:08:06.010921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3960): Terminating (SIGTERM) 16:08:06.050413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3963): Terminating (SIGTERM) 16:08:06.089857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3966): Terminating (SIGTERM) 16:08:06.129708 --- ParallelTerminationStrategy: PID 3960 died... 16:08:06.148929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3960): Terminated: ok {rc=0} 16:08:06.192774 --- ParallelTerminationStrategy: PID 3963 died... 16:08:06.211522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3963): Terminated: ok {rc=0} 16:08:06.255181 --- ParallelTerminationStrategy: PID 3966 died... 16:08:06.273626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3966): Terminated: ok {rc=0} 16:08:06.357669 bus /sierra_3: Setting Powered False 16:08:07.453494 bus /sierra_3: Setting Powered False 16:08:08.569609 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:08:09.821295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:08:09.828397 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:08:09.862532 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:08:09.890655 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:08:09.944082 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:08:09.978665 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:08:10.005957 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:08:10.555138 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:08:10.610250 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:10.622025 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:08:10.694816 tst mo_mt_call.py: using LAC 34733 16:08:10.825355 tst mo_mt_call.py: using RAC 53 16:08:10.955007 tst mo_mt_call.py: using CellId 34733 16:08:11.085906 tst mo_mt_call.py: using BVCI 34734 16:08:11.205652 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:11.217417 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:11.228915 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:11.240638 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:11.252692 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:11.264674 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:08:11.383683 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:08:11.503970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:11.981574 run create_hlr_db(pid=3972): Launched 16:08:12.108613 bus /sierra_2: Setting Powered False 16:08:13.169852 run create_hlr_db(pid=3972): Terminated: ok {rc=0} 16:08:13.621740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3974): Launched 16:08:13.951806 run osmo-hlr_10.42.42.2(pid=3975): Launched 16:08:14.077915 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:14.648832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3977): Launched 16:08:14.980496 run osmo-stp_10.42.42.5(pid=3978): Launched 16:08:15.106754 run osmo-msc_10.42.42.6: Starting osmo-msc 16:08:15.703904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3980): Launched 16:08:16.061814 run osmo-msc_10.42.42.6(pid=3981): Launched 16:08:16.271669 run osmo-stp_10.42.42.5(pid=3978): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3978)] 16:08:16.467605 run osmo-stp_10.42.42.5(pid=3978): stdout: | (launched: 2022-12-13_16:08:14.919822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:16.758306 run osmo-stp_10.42.42.5(pid=3978): stderr: | [0;m[38;5;43m20221213160815110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160815110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160815110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160815111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160815111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160815111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160815111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:16.975806 run osmo-stp_10.42.42.5(pid=3978): stdout: | (launched: 2022-12-13_16:08:14.919822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:17.110074 run osmo-stp_10.42.42.5(pid=3978): stderr: | [0;m[38;5;43m20221213160815110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160815110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160815110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160815111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160815111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160815111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160815111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:17.270848 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3978): Process ended prematurely: osmo-stp_10.42.42.5(pid=3978) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3978)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:08:17.280660 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 16:08:17.308626 run osmo-hlr_10.42.42.2(pid=3975): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3975)] 16:08:17.360820 run osmo-hlr_10.42.42.2(pid=3975): stdout: | (launched: 2022-12-13_16:08:13.891540) 16:08:17.413684 run osmo-hlr_10.42.42.2(pid=3975): stderr: | [0;m[1;31m20221213160814086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160814086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160814086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160814086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160814086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160814086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160814098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160814107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160814107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160814107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:17.488020 run osmo-msc_10.42.42.6(pid=3981): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3981)] 16:08:17.538374 run osmo-msc_10.42.42.6(pid=3981): stdout: | (launched: 2022-12-13_16:08:15.995522) 16:08:17.591781 run osmo-msc_10.42.42.6(pid=3981): stderr: | [0;m[38;5;43m20221213160816610 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160816610 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7c25694c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160816610 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160816610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160816611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160816611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160816621 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160816621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160816621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160816621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:08:17.645268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3974): Terminating (SIGTERM) 16:08:17.687473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3977): Terminating (SIGTERM) 16:08:17.730172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3980): Terminating (SIGTERM) 16:08:17.773148 --- ParallelTerminationStrategy: PID 3974 died... 16:08:17.794087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3974): Terminated: ok {rc=0} 16:08:17.841251 --- ParallelTerminationStrategy: PID 3977 died... 16:08:17.861624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3977): Terminated: ok {rc=0} 16:08:17.908119 --- ParallelTerminationStrategy: PID 3980 died... 16:08:17.928032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3980): Terminated: ok {rc=0} 16:08:18.017669 bus /sierra_3: Setting Powered False 16:08:19.116507 bus /sierra_3: Setting Powered False 16:08:20.230074 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:08:21.379806 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:21.392452 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:08:21.466834 tst mo_mt_call_osmux.py: using LAC 34734 16:08:21.598351 tst mo_mt_call_osmux.py: using RAC 54 16:08:21.721483 tst mo_mt_call_osmux.py: using CellId 34734 16:08:21.842778 tst mo_mt_call_osmux.py: using BVCI 34735 16:08:21.956478 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:21.967834 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:21.979190 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:21.990386 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:22.001667 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:08:22.012619 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:08:22.131691 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:08:22.254472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:22.732388 run create_hlr_db(pid=3983): Launched 16:08:22.858960 bus /sierra_2: Setting Powered False 16:08:23.920852 run create_hlr_db(pid=3983): Terminated: ok {rc=0} 16:08:24.371252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3985): Launched 16:08:24.706445 run osmo-hlr_10.42.42.2(pid=3986): Launched 16:08:24.833157 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:25.404884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3988): Launched 16:08:25.738092 run osmo-stp_10.42.42.5(pid=3989): Launched 16:08:25.863690 run osmo-msc_10.42.42.6: Starting osmo-msc 16:08:26.462850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3991): Launched 16:08:26.796092 run osmo-msc_10.42.42.6(pid=3992): Launched 16:08:26.979899 run osmo-stp_10.42.42.5(pid=3989): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3989)] 16:08:27.120043 run osmo-stp_10.42.42.5(pid=3989): stdout: | (launched: 2022-12-13_16:08:25.677398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:27.261241 run osmo-stp_10.42.42.5(pid=3989): stderr: | [0;m[38;5;43m20221213160825868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160825868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160825868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160825868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160825869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160825869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160825869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:27.399361 run osmo-stp_10.42.42.5(pid=3989): stdout: | (launched: 2022-12-13_16:08:25.677398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:27.531093 run osmo-stp_10.42.42.5(pid=3989): stderr: | [0;m[38;5;43m20221213160825868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160825868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160825868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160825868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160825869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160825869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160825869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:27.688821 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3989): Process ended prematurely: osmo-stp_10.42.42.5(pid=3989) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3989)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:08:27.698921 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:08:27.726751 run osmo-hlr_10.42.42.2(pid=3986): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3986)] 16:08:27.777661 run osmo-hlr_10.42.42.2(pid=3986): stdout: | (launched: 2022-12-13_16:08:24.645322) 16:08:27.829635 run osmo-hlr_10.42.42.2(pid=3986): stderr: | [0;m[1;31m20221213160824841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160824841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160824841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160824841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160824841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160824842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160824854 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160824862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160824863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160824863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:27.902608 run osmo-msc_10.42.42.6(pid=3992): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3992)] 16:08:27.952611 run osmo-msc_10.42.42.6(pid=3992): stdout: | (launched: 2022-12-13_16:08:26.735371) 16:08:28.004486 run osmo-msc_10.42.42.6(pid=3992): stderr: | [0;m[38;5;43m20221213160827057 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160827057 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b61ec4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160827057 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160827057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160827057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160827058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160827059 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160827060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160827060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160827060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:08:28.056767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3985): Terminating (SIGTERM) 16:08:28.099160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3988): Terminating (SIGTERM) 16:08:28.141946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3991): Terminating (SIGTERM) 16:08:28.184896 --- ParallelTerminationStrategy: PID 3985 died... 16:08:28.205506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3985): Terminated: ok {rc=0} 16:08:28.251805 --- ParallelTerminationStrategy: PID 3988 died... 16:08:28.271697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3988): Terminated: ok {rc=0} 16:08:28.317885 --- ParallelTerminationStrategy: PID 3991 died... 16:08:28.337818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3991): Terminated: ok {rc=0} 16:08:28.426382 bus /sierra_3: Setting Powered False 16:08:29.525130 bus /sierra_3: Setting Powered False 16:08:30.643860 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:08:31.917645 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:08:31.928021 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:08:31.971851 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:08:32.004585 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:08:32.065351 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:08:32.117402 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:08:32.154234 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:08:32.678485 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:08:32.728014 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:32.739577 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:08:32.811355 tst mo_mt_call.py: using LAC 34735 16:08:32.932438 tst mo_mt_call.py: using RAC 55 16:08:33.055368 tst mo_mt_call.py: using CellId 34735 16:08:33.177608 tst mo_mt_call.py: using BVCI 34736 16:08:33.288484 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:33.299894 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:33.311059 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:33.322277 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:33.333564 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:33.345021 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:08:33.465854 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:08:33.588617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:34.098259 run create_hlr_db(pid=3997): Launched 16:08:34.224084 bus /sierra_2: Setting Powered False 16:08:35.289291 run create_hlr_db(pid=3997): Terminated: ok {rc=0} 16:08:35.729275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3999): Launched 16:08:36.038812 run osmo-hlr_10.42.42.2(pid=4000): Launched 16:08:36.157446 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:36.687271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4002): Launched 16:08:36.996054 run osmo-stp_10.42.42.5(pid=4003): Launched 16:08:37.113738 run osmo-msc_10.42.42.6: Starting osmo-msc 16:08:37.672257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4005): Launched 16:08:37.984104 run osmo-msc_10.42.42.6(pid=4006): Launched 16:08:38.157560 run osmo-stp_10.42.42.5(pid=4003): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4003)] 16:08:38.287609 run osmo-stp_10.42.42.5(pid=4003): stdout: | (launched: 2022-12-13_16:08:36.939424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:38.419014 run osmo-stp_10.42.42.5(pid=4003): stderr: | [0;m[38;5;43m20221213160837107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160837107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160837108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160837108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160837109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160837109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160837109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:38.548113 run osmo-stp_10.42.42.5(pid=4003): stdout: | (launched: 2022-12-13_16:08:36.939424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:38.671089 run osmo-stp_10.42.42.5(pid=4003): stderr: | [0;m[38;5;43m20221213160837107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160837107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160837108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160837108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160837109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160837109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160837109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:38.818279 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4003): Process ended prematurely: osmo-stp_10.42.42.5(pid=4003) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4003)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:08:38.827639 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:08:38.854255 run osmo-hlr_10.42.42.2(pid=4000): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4000)] 16:08:38.902283 run osmo-hlr_10.42.42.2(pid=4000): stdout: | (launched: 2022-12-13_16:08:35.981994) 16:08:38.952068 run osmo-hlr_10.42.42.2(pid=4000): stderr: | [0;m[1;31m20221213160836156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160836156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160836156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160836156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160836156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160836156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160836168 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160836176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160836177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160836177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:39.021570 run osmo-msc_10.42.42.6(pid=4006): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4006)] 16:08:39.069133 run osmo-msc_10.42.42.6(pid=4006): stdout: | (launched: 2022-12-13_16:08:37.925792) 16:08:39.118718 run osmo-msc_10.42.42.6(pid=4006): stderr: | [0;m[38;5;43m20221213160838197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160838197 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5686b64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160838197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160838197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160838198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160838198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160838199 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160838200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160838200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160838200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:08:39.168312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3999): Terminating (SIGTERM) 16:08:39.208845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4002): Terminating (SIGTERM) 16:08:39.249499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4005): Terminating (SIGTERM) 16:08:39.289761 --- ParallelTerminationStrategy: PID 3999 died... 16:08:39.309400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3999): Terminated: ok {rc=0} 16:08:39.353726 --- ParallelTerminationStrategy: PID 4002 died... 16:08:39.372450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4002): Terminated: ok {rc=0} 16:08:39.416638 --- ParallelTerminationStrategy: PID 4005 died... 16:08:39.435620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4005): Terminated: ok {rc=0} 16:08:39.521597 bus /sierra_3: Setting Powered False 16:08:40.621230 bus /sierra_3: Setting Powered False 16:08:41.735537 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:08:42.882972 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:42.895209 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:08:42.966902 tst mo_mt_call_osmux.py: using LAC 34736 16:08:43.095871 tst mo_mt_call_osmux.py: using RAC 56 16:08:43.224234 tst mo_mt_call_osmux.py: using CellId 34736 16:08:43.353549 tst mo_mt_call_osmux.py: using BVCI 34737 16:08:43.467037 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:43.478932 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:43.490295 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:43.501788 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:43.513255 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:08:43.524560 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:08:43.647492 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:08:43.767642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:44.279349 run create_hlr_db(pid=4008): Launched 16:08:44.407951 bus /sierra_2: Setting Powered False 16:08:45.472327 run create_hlr_db(pid=4008): Terminated: ok {rc=0} 16:08:45.929507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4010): Launched 16:08:46.252824 run osmo-hlr_10.42.42.2(pid=4011): Launched 16:08:46.397393 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:47.169834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4023): Launched 16:08:47.543286 run osmo-stp_10.42.42.5(pid=4042): Launched 16:08:47.826257 run osmo-msc_10.42.42.6: Starting osmo-msc 16:08:48.631067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4094): Launched 16:08:49.062149 run osmo-msc_10.42.42.6(pid=4164): Launched 16:08:49.494756 run osmo-stp_10.42.42.5(pid=4042): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4042)] 16:08:49.832389 run osmo-stp_10.42.42.5(pid=4042): stdout: | (launched: 2022-12-13_16:08:47.483119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:50.024127 run osmo-stp_10.42.42.5(pid=4042): stderr: | [0;m[38;5;43m20221213160847842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160847843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160847843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160847843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160847844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160847844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160847844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:50.165823 run osmo-stp_10.42.42.5(pid=4042): stdout: | (launched: 2022-12-13_16:08:47.483119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:50.314716 run osmo-stp_10.42.42.5(pid=4042): stderr: | [0;m[38;5;43m20221213160847842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160847843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160847843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160847843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160847844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160847844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160847844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:50.478516 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4042): Process ended prematurely: osmo-stp_10.42.42.5(pid=4042) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4042)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:08:50.489496 tst mo_mt_call_osmux.py:8: Test FAILED (7.6 sec) 16:08:50.518730 run osmo-hlr_10.42.42.2(pid=4011): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4011)] 16:08:50.574211 run osmo-hlr_10.42.42.2(pid=4011): stdout: | (launched: 2022-12-13_16:08:46.192010) 16:08:50.630665 run osmo-hlr_10.42.42.2(pid=4011): stderr: | [0;m[1;31m20221213160846590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160846590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160846590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160846590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160846590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160846591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160846623 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160846640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160846640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160846640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:50.707451 run osmo-msc_10.42.42.6(pid=4164): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4164)] 16:08:50.760142 run osmo-msc_10.42.42.6(pid=4164): stdout: | (launched: 2022-12-13_16:08:48.987725) 16:08:50.816084 run osmo-msc_10.42.42.6(pid=4164): stderr: | [0;m[38;5;43m20221213160849559 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160849559 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbf252dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160849559 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160849560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160849560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160849560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160849568 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160849568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160849568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160849568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:08:50.871657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4010): Terminating (SIGTERM) 16:08:50.915475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4023): Terminating (SIGTERM) 16:08:50.962270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4094): Terminating (SIGTERM) 16:08:51.011031 --- ParallelTerminationStrategy: PID 4010 died... 16:08:51.033310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4010): Terminated: ok {rc=0} 16:08:51.083054 --- ParallelTerminationStrategy: PID 4023 died... 16:08:51.105114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4023): Terminated: ok {rc=0} 16:08:51.153695 --- ParallelTerminationStrategy: PID 4094 died... 16:08:51.175450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4094): Terminated: ok {rc=0} 16:08:51.268352 bus /sierra_3: Setting Powered False 16:08:52.368743 bus /sierra_3: Setting Powered False 16:08:53.487106 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:08:54.755244 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:08:54.762446 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:08:54.801875 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:08:54.831579 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:08:54.886525 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:08:54.923388 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:08:54.953839 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:08:55.505537 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:08:55.563429 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:08:55.576339 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:08:55.662021 tst mo_mt_call.py: using LAC 34737 16:08:55.808773 tst mo_mt_call.py: using RAC 57 16:08:55.943807 tst mo_mt_call.py: using CellId 34737 16:08:56.076657 tst mo_mt_call.py: using BVCI 34738 16:08:56.201892 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:08:56.214593 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:08:56.227085 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:08:56.239578 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:08:56.253405 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:08:56.267077 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:08:56.399852 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:08:56.529253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:57.058025 run create_hlr_db(pid=4294): Launched 16:08:57.226519 bus /sierra_2: Setting Powered False 16:08:58.292427 run create_hlr_db(pid=4294): Terminated: ok {rc=0} 16:08:58.769860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4296): Launched 16:08:59.121187 run osmo-hlr_10.42.42.2(pid=4297): Launched 16:08:59.376110 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:00.061771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4299): Launched 16:09:00.414845 run osmo-stp_10.42.42.5(pid=4300): Launched 16:09:00.672899 run osmo-msc_10.42.42.6: Starting osmo-msc 16:09:01.402575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4302): Launched 16:09:01.737247 run osmo-msc_10.42.42.6(pid=4303): Launched 16:09:02.031327 run osmo-stp_10.42.42.5(pid=4300): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4300)] 16:09:02.285231 run osmo-stp_10.42.42.5(pid=4300): stdout: | (launched: 2022-12-13_16:09:00.352296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:02.581355 run osmo-stp_10.42.42.5(pid=4300): stderr: | [0;m[38;5;43m20221213160900645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160900645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160900645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160900646 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160900646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160900646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160900646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:02.713338 run osmo-stp_10.42.42.5(pid=4300): stdout: | (launched: 2022-12-13_16:09:00.352296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:02.838878 run osmo-stp_10.42.42.5(pid=4300): stderr: | [0;m[38;5;43m20221213160900645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160900645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160900645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160900646 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160900646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160900646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160900646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:02.989479 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4300): Process ended prematurely: osmo-stp_10.42.42.5(pid=4300) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4300)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:09:02.999172 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 16:09:03.026649 run osmo-hlr_10.42.42.2(pid=4297): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4297)] 16:09:03.075864 run osmo-hlr_10.42.42.2(pid=4297): stdout: | (launched: 2022-12-13_16:08:59.059943) 16:09:03.126540 run osmo-hlr_10.42.42.2(pid=4297): stderr: | [0;m[1;31m20221213160859363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160859363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160859363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160859363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160859363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160859363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160859383 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160859391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160859391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160859392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:03.197480 run osmo-msc_10.42.42.6(pid=4303): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4303)] 16:09:03.246323 run osmo-msc_10.42.42.6(pid=4303): stdout: | (launched: 2022-12-13_16:09:01.678884) 16:09:03.297476 run osmo-msc_10.42.42.6(pid=4303): stderr: | [0;m[38;5;43m20221213160902276 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160902281 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe27aeb9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160902282 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160902282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160902282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160902282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160902284 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160902284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160902284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160902289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:09:03.348659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4296): Terminating (SIGTERM) 16:09:03.390671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4299): Terminating (SIGTERM) 16:09:03.432171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4302): Terminating (SIGTERM) 16:09:03.474617 --- ParallelTerminationStrategy: PID 4296 died... 16:09:03.494765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4296): Terminated: ok {rc=0} 16:09:03.543112 --- ParallelTerminationStrategy: PID 4299 died... 16:09:03.563079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4299): Terminated: ok {rc=0} 16:09:03.609151 --- ParallelTerminationStrategy: PID 4302 died... 16:09:03.629183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4302): Terminated: ok {rc=0} 16:09:03.717627 bus /sierra_3: Setting Powered False 16:09:04.819591 bus /sierra_3: Setting Powered False 16:09:05.938060 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:09:07.090614 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:09:07.103769 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:09:07.177788 tst mo_mt_call_osmux.py: using LAC 34738 16:09:07.304317 tst mo_mt_call_osmux.py: using RAC 58 16:09:07.432290 tst mo_mt_call_osmux.py: using CellId 34738 16:09:07.562855 tst mo_mt_call_osmux.py: using BVCI 34739 16:09:07.683201 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:09:07.695591 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:09:07.708269 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:09:07.720304 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:09:07.732564 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:09:07.745243 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:09:07.868342 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:09:07.996740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:08.493191 run create_hlr_db(pid=4305): Launched 16:09:08.661906 bus /sierra_2: Setting Powered False 16:09:09.725599 run create_hlr_db(pid=4305): Terminated: ok {rc=0} 16:09:10.175944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4307): Launched 16:09:10.513580 run osmo-hlr_10.42.42.2(pid=4308): Launched 16:09:10.771662 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:11.353097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4310): Launched 16:09:11.663185 run osmo-stp_10.42.42.5(pid=4311): Launched 16:09:11.782875 run osmo-msc_10.42.42.6: Starting osmo-msc 16:09:12.339606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4313): Launched 16:09:12.650346 run osmo-msc_10.42.42.6(pid=4314): Launched 16:09:12.826672 run osmo-stp_10.42.42.5(pid=4311): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4311)] 16:09:12.956659 run osmo-stp_10.42.42.5(pid=4311): stdout: | (launched: 2022-12-13_16:09:11.606256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:13.087704 run osmo-stp_10.42.42.5(pid=4311): stderr: | [0;m[38;5;43m20221213160911773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160911773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160911773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160911774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160911774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160911774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160911774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:13.216636 run osmo-stp_10.42.42.5(pid=4311): stdout: | (launched: 2022-12-13_16:09:11.606256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:13.340158 run osmo-stp_10.42.42.5(pid=4311): stderr: | [0;m[38;5;43m20221213160911773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160911773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160911773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160911774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160911774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160911774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160911774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:13.488374 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4311): Process ended prematurely: osmo-stp_10.42.42.5(pid=4311) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4311)] [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:09:13.497746 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:09:13.524322 run osmo-hlr_10.42.42.2(pid=4308): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4308)] 16:09:13.572622 run osmo-hlr_10.42.42.2(pid=4308): stdout: | (launched: 2022-12-13_16:09:10.454722) 16:09:13.622279 run osmo-hlr_10.42.42.2(pid=4308): stderr: | [0;m[1;31m20221213160910794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160910794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160910794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160910794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160910794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160910794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160910828 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160910841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160910841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160910841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:13.691512 run osmo-msc_10.42.42.6(pid=4314): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4314)] 16:09:13.739293 run osmo-msc_10.42.42.6(pid=4314): stdout: | (launched: 2022-12-13_16:09:12.593088) 16:09:13.789455 run osmo-msc_10.42.42.6(pid=4314): stderr: | [0;m[38;5;43m20221213160912863 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160912863 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1b78746c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160912863 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160912863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160912863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160912864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160912865 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160912866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160912866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160912866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:09:13.839456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4307): Terminating (SIGTERM) 16:09:13.879401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4310): Terminating (SIGTERM) 16:09:13.919210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4313): Terminating (SIGTERM) 16:09:13.959256 --- ParallelTerminationStrategy: PID 4307 died... 16:09:13.978527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4307): Terminated: ok {rc=0} 16:09:14.022508 --- ParallelTerminationStrategy: PID 4310 died... 16:09:14.041286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4310): Terminated: ok {rc=0} 16:09:14.085214 --- ParallelTerminationStrategy: PID 4313 died... 16:09:14.103871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4313): Terminated: ok {rc=0} 16:09:14.187220 bus /sierra_3: Setting Powered False 16:09:15.285281 bus /sierra_3: Setting Powered False 16:09:16.413328 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 16:09:17.690460 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:09:17.695589 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:09:17.729419 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:09:17.756030 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 16:09:17.840120 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:09:17.873717 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:09:17.900269 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 16:09:18.486652 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2391 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 16:09:18.491674 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:18.502613 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:09:18.552599 tst emergency_mo_mt_call.py: using LAC 34739 16:09:18.679151 tst emergency_mo_mt_call.py: using RAC 59 16:09:18.805298 tst emergency_mo_mt_call.py: using CellId 34739 16:09:18.935042 tst emergency_mo_mt_call.py: using BVCI 34740 16:09:19.053524 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:19.065165 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:19.076474 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:19.087760 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:19.099485 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:19.111144 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:09:19.234223 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:09:19.352085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:19.822211 run create_hlr_db(pid=4319): Launched 16:09:19.946552 bus /sierra_2: Setting Powered False 16:09:21.007258 run create_hlr_db(pid=4319): Terminated: ok {rc=0} 16:09:21.451913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4321): Launched 16:09:21.778302 run osmo-hlr_10.42.42.2(pid=4322): Launched 16:09:21.909383 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:22.466238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4324): Launched 16:09:22.792813 run osmo-stp_10.42.42.5(pid=4325): Launched 16:09:22.928725 tst emergency_mo_mt_call.py: using MSISDN 8216 16:09:23.097956 run osmo-msc_10.42.42.6: Starting osmo-msc 16:09:23.683420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4327): Launched 16:09:24.010534 run osmo-msc_10.42.42.6(pid=4328): Launched 16:09:24.193663 run osmo-stp_10.42.42.5(pid=4325): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4325)] 16:09:24.330543 run osmo-stp_10.42.42.5(pid=4325): stdout: | (launched: 2022-12-13_16:09:22.732798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:24.467903 run osmo-stp_10.42.42.5(pid=4325): stderr: | [0;m[38;5;43m20221213160922923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160922923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160922923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160922924 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160922924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160922924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160922924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:24.604006 run osmo-stp_10.42.42.5(pid=4325): stdout: | (launched: 2022-12-13_16:09:22.732798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:24.733267 run osmo-stp_10.42.42.5(pid=4325): stderr: | [0;m[38;5;43m20221213160922923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160922923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160922923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160922924 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160922924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160922924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160922924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:24.888399 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4325): Process ended prematurely: osmo-stp_10.42.42.5(pid=4325) [trial-2391↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4325)] [trial-2391↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 16:09:24.897884 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 16:09:24.925796 run osmo-hlr_10.42.42.2(pid=4322): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4322)] 16:09:24.978138 run osmo-hlr_10.42.42.2(pid=4322): stdout: | (launched: 2022-12-13_16:09:21.718540) 16:09:25.031900 run osmo-hlr_10.42.42.2(pid=4322): stderr: | [0;m[1;31m20221213160921915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160921915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160921915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160921915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160921915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160921915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160921947 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160921956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160921957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160921957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:25.105580 run osmo-msc_10.42.42.6(pid=4328): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4328)] 16:09:25.156125 run osmo-msc_10.42.42.6(pid=4328): stdout: | (launched: 2022-12-13_16:09:23.950573) 16:09:25.208803 run osmo-msc_10.42.42.6(pid=4328): stderr: | [0;m[38;5;43m20221213160924269 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160924269 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a3f708c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160924269 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160924269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160924269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160924269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160924271 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160924271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160924272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160924272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:09:25.261903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4321): Terminating (SIGTERM) 16:09:25.304551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4324): Terminating (SIGTERM) 16:09:25.347078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4327): Terminating (SIGTERM) 16:09:25.389715 --- ParallelTerminationStrategy: PID 4321 died... 16:09:25.409723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4321): Terminated: ok {rc=0} 16:09:25.456513 --- ParallelTerminationStrategy: PID 4324 died... 16:09:25.476498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4324): Terminated: ok {rc=0} 16:09:25.522977 --- ParallelTerminationStrategy: PID 4327 died... 16:09:25.543050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4327): Terminated: ok {rc=0} 16:09:25.633090 bus /sierra_3: Setting Powered False 16:09:26.733168 bus /sierra_3: Setting Powered False 16:09:27.848631 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 16:09:28.935546 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:28.947810 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:09:29.002893 tst emergency_preemptive_call.py: using LAC 34740 16:09:29.131117 tst emergency_preemptive_call.py: using RAC 60 16:09:29.262578 tst emergency_preemptive_call.py: using CellId 34740 16:09:29.389723 tst emergency_preemptive_call.py: using BVCI 34741 16:09:29.507407 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:29.518891 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:29.530126 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:29.541307 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:29.553120 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:09:29.564676 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:09:29.682726 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:09:29.802716 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:09:29.920302 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:09:30.038484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:30.508796 run create_hlr_db(pid=4330): Launched 16:09:30.634775 bus /sierra_2: Setting Powered False 16:09:31.701884 run create_hlr_db(pid=4330): Terminated: ok {rc=0} 16:09:32.241804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4332): Launched 16:09:32.559895 run osmo-hlr_10.42.42.2(pid=4333): Launched 16:09:32.677574 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:33.198495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4335): Launched 16:09:33.503507 run osmo-stp_10.42.42.5(pid=4336): Launched 16:09:33.629668 tst emergency_preemptive_call.py: using MSISDN 8217 16:09:33.785023 run osmo-msc_10.42.42.6: Starting osmo-msc 16:09:34.329346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4338): Launched 16:09:34.633408 run osmo-msc_10.42.42.6(pid=4339): Launched 16:09:34.803775 run osmo-stp_10.42.42.5(pid=4336): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4336)] 16:09:34.931527 run osmo-stp_10.42.42.5(pid=4336): stdout: | (launched: 2022-12-13_16:09:33.447347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:35.059576 run osmo-stp_10.42.42.5(pid=4336): stderr: | [0;m[38;5;43m20221213160933616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160933617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160933617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160933617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160933618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160933618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160933618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:35.185492 run osmo-stp_10.42.42.5(pid=4336): stdout: | (launched: 2022-12-13_16:09:33.447347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:35.305623 run osmo-stp_10.42.42.5(pid=4336): stderr: | [0;m[38;5;43m20221213160933616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160933617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160933617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160933617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160933618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160933618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160933618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:35.449508 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4336): Process ended prematurely: osmo-stp_10.42.42.5(pid=4336) [trial-2391↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4336)] [trial-2391↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 16:09:35.457915 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 16:09:35.484093 run osmo-hlr_10.42.42.2(pid=4333): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4333)] 16:09:35.532910 run osmo-hlr_10.42.42.2(pid=4333): stdout: | (launched: 2022-12-13_16:09:32.503734) 16:09:35.582585 run osmo-hlr_10.42.42.2(pid=4333): stderr: | [0;m[1;31m20221213160932678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160932678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160932678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160932678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160932678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160932678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160932711 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160932721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160932722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160932722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:35.652346 run osmo-msc_10.42.42.6(pid=4339): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4339)] 16:09:35.700168 run osmo-msc_10.42.42.6(pid=4339): stdout: | (launched: 2022-12-13_16:09:34.576908) 16:09:35.749545 run osmo-msc_10.42.42.6(pid=4339): stderr: | [0;m[38;5;43m20221213160934846 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213160934846 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd691581c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213160934846 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213160934846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213160934846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213160934847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213160934848 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213160934849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213160934849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213160934849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:09:35.799477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4332): Terminating (SIGTERM) 16:09:35.839220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4335): Terminating (SIGTERM) 16:09:35.878934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4338): Terminating (SIGTERM) 16:09:35.918756 --- ParallelTerminationStrategy: PID 4332 died... 16:09:35.937465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4332): Terminated: ok {rc=0} 16:09:35.981499 --- ParallelTerminationStrategy: PID 4335 died... 16:09:36.000144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4335): Terminated: ok {rc=0} 16:09:36.043835 --- ParallelTerminationStrategy: PID 4338 died... 16:09:36.062598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4338): Terminated: ok {rc=0} 16:09:36.148570 bus /sierra_9: Setting Powered False 16:09:37.248866 bus /sierra_9: Setting Powered False 16:09:38.364269 bus /sierra_8: Setting Powered False 16:09:39.464215 bus /sierra_8: Setting Powered False 16:09:40.581360 bus /sierra_3: Setting Powered False 16:09:41.679190 bus /sierra_3: Setting Powered False 16:09:42.798508 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 16:09:44.082013 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:09:44.086683 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:09:44.120271 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 16:09:44.158831 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 16:09:44.246279 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:09:44.279693 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 16:09:44.318028 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 16:09:44.910946 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 16:09:44.960847 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:44.971714 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:09:45.021562 tst cs_paging_gprs_active.py: using LAC 34741 16:09:45.144699 tst cs_paging_gprs_active.py: using RAC 61 16:09:45.267397 tst cs_paging_gprs_active.py: using CellId 34741 16:09:45.390343 tst cs_paging_gprs_active.py: using BVCI 34742 16:09:45.503666 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:45.514504 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:45.525128 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:45.535698 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:45.546187 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:45.556590 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:45.567837 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:45.578789 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:45.589558 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:09:45.712873 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:09:45.841082 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:09:46.092701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:46.413900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4347): Launched 16:09:46.709831 run iperf3-srv_10.42.42.10(pid=4348): Launched 16:09:46.846853 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:09:47.077871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:47.415480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4349): Launched 16:09:47.705831 run iperf3-srv_10.42.42.10(pid=4350): Launched 16:09:47.830915 tst cs_paging_gprs_active.py:38: start network... 16:09:48.054626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:48.567694 run create_hlr_db(pid=4351): Launched 16:09:48.696786 bus /sierra_2: Setting Powered False 16:09:49.762489 run create_hlr_db(pid=4351): Terminated: ok {rc=0} 16:09:50.225025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4353): Launched 16:09:50.560143 run osmo-hlr_10.42.42.2(pid=4354): Launched 16:09:50.687505 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:51.229416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4356): Launched 16:09:51.540736 run osmo-stp_10.42.42.5(pid=4357): Launched 16:09:51.659577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:09:52.194921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4359): Launched 16:09:52.314375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:09:52.577404 run patchelf(pid=4360): Launched 16:09:52.750725 run osmo-stp_10.42.42.5(pid=4357): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4357)] 16:09:52.881872 run osmo-stp_10.42.42.5(pid=4357): stdout: | (launched: 2022-12-13_16:09:51.483219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:53.014557 run osmo-stp_10.42.42.5(pid=4357): stderr: | [0;m[38;5;43m20221213160951654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160951654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160951654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160951655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160951655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160951655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160951655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:53.147510 run osmo-stp_10.42.42.5(pid=4357): stdout: | (launched: 2022-12-13_16:09:51.483219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:53.274511 run osmo-stp_10.42.42.5(pid=4357): stderr: | [0;m[38;5;43m20221213160951654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213160951654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213160951654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213160951655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213160951655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213160951655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213160951655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:53.424578 run patchelf(pid=4360): Terminating (SIGINT) 16:09:53.599188 run patchelf(pid=4360): Terminated: ok {rc=0} 16:09:53.725216 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4357): Process ended prematurely: osmo-stp_10.42.42.5(pid=4357) [trial-2391↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4357)] [trial-2391↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 16:09:53.734793 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:09:53.761875 run osmo-hlr_10.42.42.2(pid=4354): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4354)] 16:09:53.809882 run osmo-hlr_10.42.42.2(pid=4354): stdout: | (launched: 2022-12-13_16:09:50.499225) 16:09:53.859098 run osmo-hlr_10.42.42.2(pid=4354): stderr: | [0;m[1;31m20221213160950698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213160950698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213160950698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213160950698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213160950698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213160950698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213160950711 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213160950721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213160950721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213160950721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:53.908662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4347): Terminating (SIGTERM) 16:09:53.948440 run iperf3-srv_10.42.42.10(pid=4348): Terminating (SIGTERM) 16:09:53.988164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4349): Terminating (SIGTERM) 16:09:54.028212 run iperf3-srv_10.42.42.10(pid=4350): Terminating (SIGTERM) 16:09:54.068056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4353): Terminating (SIGTERM) 16:09:54.108114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4356): Terminating (SIGTERM) 16:09:54.148047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4359): Terminating (SIGTERM) 16:09:54.187997 --- ParallelTerminationStrategy: PID 4347 died... 16:09:54.207224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4347): Terminated: ok {rc=0} 16:09:54.251189 --- ParallelTerminationStrategy: PID 4348 died... 16:09:54.269864 run iperf3-srv_10.42.42.10(pid=4348): Terminated {rc=256} 16:09:54.313307 --- ParallelTerminationStrategy: PID 4349 died... 16:09:54.331912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4349): Terminated: ok {rc=0} 16:09:54.375294 --- ParallelTerminationStrategy: PID 4350 died... 16:09:54.393754 run iperf3-srv_10.42.42.10(pid=4350): Terminated {rc=256} 16:09:54.437190 --- ParallelTerminationStrategy: PID 4353 died... 16:09:54.455556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4353): Terminated: ok {rc=0} 16:09:54.499089 --- ParallelTerminationStrategy: PID 4356 died... 16:09:54.517747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4356): Terminated: ok {rc=0} 16:09:54.561265 --- ParallelTerminationStrategy: PID 4359 died... 16:09:54.579919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4359): Terminated: ok {rc=0} 16:09:54.665226 bus /gobi_0: Setting Powered False 16:09:55.764894 bus /gobi_0: Setting Powered False 16:09:56.881124 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 16:09:58.027878 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:58.039536 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:09:58.092308 tst iperf3.py: using LAC 34742 16:09:58.214069 tst iperf3.py: using RAC 62 16:09:58.337016 tst iperf3.py: using CellId 34742 16:09:58.460092 tst iperf3.py: using BVCI 34743 16:09:58.573643 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:58.584424 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:58.595051 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:58.605715 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:58.616243 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:58.627012 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:58.637822 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:58.648436 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:58.659229 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:09:58.776641 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:09:58.984138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:59.295787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4361): Launched 16:09:59.568178 run iperf3-srv_10.42.42.10(pid=4362): Launched 16:09:59.685341 tst iperf3.py:8: start network... 16:09:59.894395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:00.376651 run create_hlr_db(pid=4363): Launched 16:10:00.504085 bus /gobi_6: Setting Powered False 16:10:01.591526 run create_hlr_db(pid=4363): Terminated: ok {rc=0} 16:10:02.041108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4368): Launched 16:10:02.371362 run osmo-hlr_10.42.42.2(pid=4369): Launched 16:10:02.491920 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:03.040672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4371): Launched 16:10:03.353107 run osmo-stp_10.42.42.5(pid=4372): Launched 16:10:03.471680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:04.006516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4374): Launched 16:10:04.125720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:04.388560 run patchelf(pid=4375): Launched 16:10:04.561276 run osmo-stp_10.42.42.5(pid=4372): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4372)] 16:10:04.692743 run osmo-stp_10.42.42.5(pid=4372): stdout: | (launched: 2022-12-13_16:10:03.295488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:04.825835 run osmo-stp_10.42.42.5(pid=4372): stderr: | [0;m[38;5;43m20221213161003467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161003467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161003468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161003468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161003468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161003469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161003469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:04.959191 run osmo-stp_10.42.42.5(pid=4372): stdout: | (launched: 2022-12-13_16:10:03.295488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:05.086560 run osmo-stp_10.42.42.5(pid=4372): stderr: | [0;m[38;5;43m20221213161003467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161003467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161003468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161003468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161003468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161003469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161003469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:05.237275 run patchelf(pid=4375): Terminating (SIGINT) 16:10:05.411995 run patchelf(pid=4375): Terminated: ok {rc=0} 16:10:05.538582 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4372): Process ended prematurely: osmo-stp_10.42.42.5(pid=4372) [trial-2391↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4372)] [trial-2391↪gprs:trx-sysmocell5000↪iperf3.py:8] 16:10:05.548190 tst iperf3.py:8: Test FAILED (7.6 sec) 16:10:05.575484 run osmo-hlr_10.42.42.2(pid=4369): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4369)] 16:10:05.623827 run osmo-hlr_10.42.42.2(pid=4369): stdout: | (launched: 2022-12-13_16:10:02.313558) 16:10:05.673437 run osmo-hlr_10.42.42.2(pid=4369): stderr: | [0;m[1;31m20221213161002487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161002487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161002487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161002487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161002487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161002487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161002500 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161002510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161002510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161002511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:05.723585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4361): Terminating (SIGTERM) 16:10:05.763698 run iperf3-srv_10.42.42.10(pid=4362): Terminating (SIGTERM) 16:10:05.803661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4368): Terminating (SIGTERM) 16:10:05.843496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4371): Terminating (SIGTERM) 16:10:05.883780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4374): Terminating (SIGTERM) 16:10:05.924041 --- ParallelTerminationStrategy: PID 4361 died... 16:10:05.943426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4361): Terminated: ok {rc=0} 16:10:05.987576 --- ParallelTerminationStrategy: PID 4362 died... 16:10:06.006479 run iperf3-srv_10.42.42.10(pid=4362): Terminated {rc=256} 16:10:06.050316 --- ParallelTerminationStrategy: PID 4368 died... 16:10:06.069383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4368): Terminated: ok {rc=0} 16:10:06.113567 --- ParallelTerminationStrategy: PID 4371 died... 16:10:06.132510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4371): Terminated: ok {rc=0} 16:10:06.176865 --- ParallelTerminationStrategy: PID 4374 died... 16:10:06.196181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4374): Terminated: ok {rc=0} 16:10:06.281760 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 16:10:07.430188 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:07.442137 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:10:07.496551 tst iperf3m4.py: using LAC 34743 16:10:07.620621 tst iperf3m4.py: using RAC 63 16:10:07.746711 tst iperf3m4.py: using CellId 34743 16:10:07.876322 tst iperf3m4.py: using BVCI 34744 16:10:07.997380 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:08.008927 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:08.020285 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:08.031813 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:08.043429 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:08.054838 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:08.066621 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:08.078096 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:08.089731 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:10:08.209640 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:10:08.333737 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:10:08.451649 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:10:08.574654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:10:08.799356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:09.133767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4376): Launched 16:10:09.423783 run iperf3-srv_10.42.42.10(pid=4377): Launched 16:10:09.550390 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:10:09.773989 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:10.108270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4378): Launched 16:10:10.399405 run iperf3-srv_10.42.42.10(pid=4379): Launched 16:10:10.525890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:10:10.750641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:11.084728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4380): Launched 16:10:11.375265 run iperf3-srv_10.42.42.10(pid=4381): Launched 16:10:11.501683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:10:11.726297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:12.061880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4382): Launched 16:10:12.351447 run iperf3-srv_10.42.42.10(pid=4383): Launched 16:10:12.477801 tst iperf3m4.py:8: start network... 16:10:12.701508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:13.215846 run create_hlr_db(pid=4384): Launched 16:10:13.343267 bus /gobi_6: Setting Powered False 16:10:14.407598 run create_hlr_db(pid=4384): Terminated: ok {rc=0} 16:10:14.868489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4386): Launched 16:10:15.205807 run osmo-hlr_10.42.42.2(pid=4387): Launched 16:10:15.330822 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:15.889362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4389): Launched 16:10:16.253745 run osmo-stp_10.42.42.5(pid=4390): Launched 16:10:16.517211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:17.097274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4392): Launched 16:10:17.226888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:17.511759 run patchelf(pid=4393): Launched 16:10:17.699001 run osmo-stp_10.42.42.5(pid=4390): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4390)] 16:10:17.840281 run osmo-stp_10.42.42.5(pid=4390): stdout: | (launched: 2022-12-13_16:10:16.186243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:17.983666 run osmo-stp_10.42.42.5(pid=4390): stderr: | [0;m[38;5;43m20221213161016395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161016396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161016396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161016396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161016397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161016397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161016397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:18.126908 run osmo-stp_10.42.42.5(pid=4390): stdout: | (launched: 2022-12-13_16:10:16.186243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:18.263560 run osmo-stp_10.42.42.5(pid=4390): stderr: | [0;m[38;5;43m20221213161016395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161016396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161016396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161016396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161016397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161016397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161016397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:18.425807 run patchelf(pid=4393): Terminating (SIGINT) 16:10:18.613644 run patchelf(pid=4393): Terminated: ok {rc=0} 16:10:18.748669 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4390): Process ended prematurely: osmo-stp_10.42.42.5(pid=4390) [trial-2391↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4390)] [trial-2391↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 16:10:18.759078 tst iperf3m4.py:8: Test FAILED (11.4 sec) 16:10:18.788170 run osmo-hlr_10.42.42.2(pid=4387): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4387)] 16:10:18.838925 run osmo-hlr_10.42.42.2(pid=4387): stdout: | (launched: 2022-12-13_16:10:15.141775) 16:10:18.891322 run osmo-hlr_10.42.42.2(pid=4387): stderr: | [0;m[1;31m20221213161015322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161015322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161015322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161015322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161015322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161015322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161015337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161015347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161015347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161015347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:18.944452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4376): Terminating (SIGTERM) 16:10:18.986617 run iperf3-srv_10.42.42.10(pid=4377): Terminating (SIGTERM) 16:10:19.029115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4378): Terminating (SIGTERM) 16:10:19.071840 run iperf3-srv_10.42.42.10(pid=4379): Terminating (SIGTERM) 16:10:19.114122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4380): Terminating (SIGTERM) 16:10:19.157000 run iperf3-srv_10.42.42.10(pid=4381): Terminating (SIGTERM) 16:10:19.199089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4382): Terminating (SIGTERM) 16:10:19.241917 run iperf3-srv_10.42.42.10(pid=4383): Terminating (SIGTERM) 16:10:19.283987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4386): Terminating (SIGTERM) 16:10:19.326368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4389): Terminating (SIGTERM) 16:10:19.368513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4392): Terminating (SIGTERM) 16:10:19.410919 --- ParallelTerminationStrategy: PID 4376 died... 16:10:19.431274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4376): Terminated: ok {rc=0} 16:10:19.478258 --- ParallelTerminationStrategy: PID 4377 died... 16:10:19.498280 run iperf3-srv_10.42.42.10(pid=4377): Terminated {rc=256} 16:10:19.544821 --- ParallelTerminationStrategy: PID 4378 died... 16:10:19.565194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4378): Terminated: ok {rc=0} 16:10:19.612022 --- ParallelTerminationStrategy: PID 4379 died... 16:10:19.632296 run iperf3-srv_10.42.42.10(pid=4379): Terminated {rc=256} 16:10:19.678845 --- ParallelTerminationStrategy: PID 4380 died... 16:10:19.698731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4380): Terminated: ok {rc=0} 16:10:19.744875 --- ParallelTerminationStrategy: PID 4381 died... 16:10:19.764638 run iperf3-srv_10.42.42.10(pid=4381): Terminated {rc=256} 16:10:19.810722 --- ParallelTerminationStrategy: PID 4382 died... 16:10:19.830610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4382): Terminated: ok {rc=0} 16:10:19.876618 --- ParallelTerminationStrategy: PID 4383 died... 16:10:19.896424 run iperf3-srv_10.42.42.10(pid=4383): Terminated {rc=256} 16:10:19.942694 --- ParallelTerminationStrategy: PID 4386 died... 16:10:19.962672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4386): Terminated: ok {rc=0} 16:10:20.009263 --- ParallelTerminationStrategy: PID 4389 died... 16:10:20.029321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4389): Terminated: ok {rc=0} 16:10:20.075950 --- ParallelTerminationStrategy: PID 4392 died... 16:10:20.095865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4392): Terminated: ok {rc=0} 16:10:20.184357 bus /gobi_4: Setting Powered False 16:10:21.284627 bus /gobi_4: Setting Powered False 16:10:22.400262 bus /gobi_1: Setting Powered False 16:10:23.499306 bus /gobi_1: Setting Powered False 16:10:24.617869 bus /gobi_0: Setting Powered False 16:10:25.717049 bus /gobi_0: Setting Powered False 16:10:26.833919 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 16:10:27.936430 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:27.948800 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:10:28.002699 tst ping.py: using LAC 34744 16:10:28.132756 tst ping.py: using RAC 64 16:10:28.261118 tst ping.py: using CellId 34744 16:10:28.388486 tst ping.py: using BVCI 34745 16:10:28.507134 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:28.518551 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:28.529911 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:28.541092 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:28.552544 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:28.564065 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:28.575689 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:28.587272 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:10:28.705502 tst ping.py:19: start network... 16:10:28.909615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:29.381220 run create_hlr_db(pid=4394): Launched 16:10:29.498462 bus /gobi_6: Setting Powered False 16:10:30.559577 run create_hlr_db(pid=4394): Terminated: ok {rc=0} 16:10:31.028324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4396): Launched 16:10:31.353750 run osmo-hlr_10.42.42.2(pid=4397): Launched 16:10:31.599948 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:32.281903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4399): Launched 16:10:32.611246 run osmo-stp_10.42.42.5(pid=4400): Launched 16:10:32.739109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:33.304445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4402): Launched 16:10:33.430495 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:33.708597 run patchelf(pid=4403): Launched 16:10:33.892510 run osmo-stp_10.42.42.5(pid=4400): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4400)] 16:10:34.030949 run osmo-stp_10.42.42.5(pid=4400): stdout: | (launched: 2022-12-13_16:10:32.550703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:34.172089 run osmo-stp_10.42.42.5(pid=4400): stderr: | [0;m[38;5;43m20221213161032741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161032741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161032742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161032742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161032742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161032743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161032743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:34.312744 run osmo-stp_10.42.42.5(pid=4400): stdout: | (launched: 2022-12-13_16:10:32.550703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:34.446459 run osmo-stp_10.42.42.5(pid=4400): stderr: | [0;m[38;5;43m20221213161032741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161032741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161032742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161032742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161032742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161032743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161032743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:34.605144 run patchelf(pid=4403): Terminating (SIGINT) 16:10:34.789365 run patchelf(pid=4403): Terminated: ok {rc=0} 16:10:34.921803 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4400): Process ended prematurely: osmo-stp_10.42.42.5(pid=4400) [trial-2391↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4400)] [trial-2391↪gprs:trx-sysmocell5000↪ping.py:22] 16:10:34.931713 tst ping.py:22: Test FAILED (7.0 sec) 16:10:34.960215 run osmo-hlr_10.42.42.2(pid=4397): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4397)] 16:10:35.011452 run osmo-hlr_10.42.42.2(pid=4397): stdout: | (launched: 2022-12-13_16:10:31.295106) 16:10:35.064551 run osmo-hlr_10.42.42.2(pid=4397): stderr: | [0;m[1;31m20221213161031602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161031602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161031602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161031602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161031602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161031602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161031613 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161031631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161031632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161031632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:35.117430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4396): Terminating (SIGTERM) 16:10:35.160121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4399): Terminating (SIGTERM) 16:10:35.202709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4402): Terminating (SIGTERM) 16:10:35.246293 --- ParallelTerminationStrategy: PID 4396 died... 16:10:35.267119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4396): Terminated: ok {rc=0} 16:10:35.314187 --- ParallelTerminationStrategy: PID 4399 died... 16:10:35.334497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4399): Terminated: ok {rc=0} 16:10:35.381365 --- ParallelTerminationStrategy: PID 4402 died... 16:10:35.401611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4402): Terminated: ok {rc=0} 16:10:35.491137 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 16:10:36.579405 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:36.591572 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:10:36.647167 tst ping_idle_ping.py: using LAC 34745 16:10:36.775183 tst ping_idle_ping.py: using RAC 65 16:10:36.905059 tst ping_idle_ping.py: using CellId 34745 16:10:37.033406 tst ping_idle_ping.py: using BVCI 34746 16:10:37.153254 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:37.164673 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:37.176111 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:37.187402 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:37.199456 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:37.211450 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:37.223707 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:10:37.235778 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:10:37.357162 tst ping_idle_ping.py:24: start network... 16:10:37.580204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:38.091341 run create_hlr_db(pid=4404): Launched 16:10:38.216250 bus /gobi_6: Setting Powered False 16:10:39.281055 run create_hlr_db(pid=4404): Terminated: ok {rc=0} 16:10:39.738528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4406): Launched 16:10:40.068374 run osmo-hlr_10.42.42.2(pid=4407): Launched 16:10:40.195161 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:40.760424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4409): Launched 16:10:41.092441 run osmo-stp_10.42.42.5(pid=4410): Launched 16:10:41.219908 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:41.786199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4412): Launched 16:10:41.912222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:42.190423 run patchelf(pid=4413): Launched 16:10:42.374972 run osmo-stp_10.42.42.5(pid=4410): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4410)] 16:10:42.513751 run osmo-stp_10.42.42.5(pid=4410): stdout: | (launched: 2022-12-13_16:10:41.031548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:42.654897 run osmo-stp_10.42.42.5(pid=4410): stderr: | [0;m[38;5;43m20221213161041224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161041224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161041224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161041225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161041225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161041225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161041225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:42.795537 run osmo-stp_10.42.42.5(pid=4410): stdout: | (launched: 2022-12-13_16:10:41.031548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:42.929413 run osmo-stp_10.42.42.5(pid=4410): stderr: | [0;m[38;5;43m20221213161041224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161041224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161041224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161041225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161041225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161041225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161041225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:43.088279 run patchelf(pid=4413): Terminating (SIGINT) 16:10:43.272427 run patchelf(pid=4413): Terminated: ok {rc=0} 16:10:43.405252 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4410): Process ended prematurely: osmo-stp_10.42.42.5(pid=4410) [trial-2391↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4410)] [trial-2391↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 16:10:43.414944 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:10:43.443373 run osmo-hlr_10.42.42.2(pid=4407): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4407)] 16:10:43.494370 run osmo-hlr_10.42.42.2(pid=4407): stdout: | (launched: 2022-12-13_16:10:40.006064) 16:10:43.546875 run osmo-hlr_10.42.42.2(pid=4407): stderr: | [0;m[1;31m20221213161040206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161040206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161040206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161040206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161040206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161040206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161040218 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161040226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161040227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161040227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:43.599560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4406): Terminating (SIGTERM) 16:10:43.642630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4409): Terminating (SIGTERM) 16:10:43.685482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4412): Terminating (SIGTERM) 16:10:43.728619 --- ParallelTerminationStrategy: PID 4406 died... 16:10:43.749269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4406): Terminated: ok {rc=0} 16:10:43.796458 --- ParallelTerminationStrategy: PID 4409 died... 16:10:43.816573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4409): Terminated: ok {rc=0} 16:10:43.863610 --- ParallelTerminationStrategy: PID 4412 died... 16:10:43.883716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4412): Terminated: ok {rc=0} 16:10:43.973230 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 16:10:45.291512 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:10:45.297337 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:10:45.332181 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:10:45.373886 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:10:45.466085 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:10:45.501331 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:10:45.541175 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:10:46.154242 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:10:46.211890 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:10:46.224255 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:10:46.281639 tst cs_paging_gprs_active.py: using LAC 34746 16:10:46.453132 tst cs_paging_gprs_active.py: using RAC 66 16:10:46.626559 tst cs_paging_gprs_active.py: using CellId 34746 16:10:46.762250 tst cs_paging_gprs_active.py: using BVCI 34747 16:10:46.886893 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:10:46.899510 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:10:46.911860 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:10:46.924466 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:10:46.937961 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:10:46.951585 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:10:46.964740 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:10:46.977903 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:10:46.991074 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:10:47.117499 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:10:47.253567 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:10:47.464102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:47.778618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4419): Launched 16:10:48.052737 run iperf3-srv_10.42.42.10(pid=4420): Launched 16:10:48.170617 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:10:48.381260 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:48.695840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4421): Launched 16:10:48.969646 run iperf3-srv_10.42.42.10(pid=4422): Launched 16:10:49.086953 tst cs_paging_gprs_active.py:38: start network... 16:10:49.296591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:49.781832 run create_hlr_db(pid=4423): Launched 16:10:49.910912 bus /gobi_6: Setting Powered False 16:10:50.972686 run create_hlr_db(pid=4423): Terminated: ok {rc=0} 16:10:51.429485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4425): Launched 16:10:51.767954 run osmo-hlr_10.42.42.2(pid=4426): Launched 16:10:51.901986 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:52.483515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4428): Launched 16:10:52.822269 run osmo-stp_10.42.42.5(pid=4429): Launched 16:10:52.951330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:53.527593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4431): Launched 16:10:53.656614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:53.940221 run patchelf(pid=4432): Launched 16:10:54.128154 run osmo-stp_10.42.42.5(pid=4429): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4429)] 16:10:54.269574 run osmo-stp_10.42.42.5(pid=4429): stdout: | (launched: 2022-12-13_16:10:52.760546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:54.412633 run osmo-stp_10.42.42.5(pid=4429): stderr: | [0;m[38;5;43m20221213161052952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161052952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161052952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161052953 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161052953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161052953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161052954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:54.556214 run osmo-stp_10.42.42.5(pid=4429): stdout: | (launched: 2022-12-13_16:10:52.760546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:54.693496 run osmo-stp_10.42.42.5(pid=4429): stderr: | [0;m[38;5;43m20221213161052952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161052952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161052952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161052953 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161052953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161052953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161052954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:54.855717 run patchelf(pid=4432): Terminating (SIGINT) 16:10:55.042687 run patchelf(pid=4432): Terminated: ok {rc=0} 16:10:55.177870 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4429): Process ended prematurely: osmo-stp_10.42.42.5(pid=4429) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4429)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:10:55.188232 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:10:55.217183 run osmo-hlr_10.42.42.2(pid=4426): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4426)] 16:10:55.268233 run osmo-hlr_10.42.42.2(pid=4426): stdout: | (launched: 2022-12-13_16:10:51.706286) 16:10:55.321470 run osmo-hlr_10.42.42.2(pid=4426): stderr: | [0;m[1;31m20221213161051911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161051911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161051911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161051911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161051911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161051911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161051924 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161051935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161051936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161051936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:55.374509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4419): Terminating (SIGTERM) 16:10:55.416779 run iperf3-srv_10.42.42.10(pid=4420): Terminating (SIGTERM) 16:10:55.459498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4421): Terminating (SIGTERM) 16:10:55.502230 run iperf3-srv_10.42.42.10(pid=4422): Terminating (SIGTERM) 16:10:55.544734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4425): Terminating (SIGTERM) 16:10:55.587511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4428): Terminating (SIGTERM) 16:10:55.630428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4431): Terminating (SIGTERM) 16:10:55.673646 --- ParallelTerminationStrategy: PID 4419 died... 16:10:55.693922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4419): Terminated: ok {rc=0} 16:10:55.741048 --- ParallelTerminationStrategy: PID 4420 died... 16:10:55.761061 run iperf3-srv_10.42.42.10(pid=4420): Terminated {rc=256} 16:10:55.808029 --- ParallelTerminationStrategy: PID 4421 died... 16:10:55.828114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4421): Terminated: ok {rc=0} 16:10:55.875082 --- ParallelTerminationStrategy: PID 4422 died... 16:10:55.895054 run iperf3-srv_10.42.42.10(pid=4422): Terminated {rc=256} 16:10:55.941820 --- ParallelTerminationStrategy: PID 4425 died... 16:10:55.961942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4425): Terminated: ok {rc=0} 16:10:56.008656 --- ParallelTerminationStrategy: PID 4428 died... 16:10:56.029233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4428): Terminated: ok {rc=0} 16:10:56.076087 --- ParallelTerminationStrategy: PID 4431 died... 16:10:56.096229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4431): Terminated: ok {rc=0} 16:10:56.186820 bus /gobi_0: Setting Powered False 16:10:57.286781 bus /gobi_0: Setting Powered False 16:10:58.404726 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:10:59.552739 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:10:59.564791 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:10:59.624903 tst iperf3.py: using LAC 34747 16:10:59.748258 tst iperf3.py: using RAC 67 16:10:59.868889 tst iperf3.py: using CellId 34747 16:10:59.988652 tst iperf3.py: using BVCI 34748 16:11:00.101336 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:00.112586 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:00.123526 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:00.134417 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:00.145239 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:00.156112 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:00.167075 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:00.177881 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:00.189451 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:11:00.311959 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:11:00.521627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:00.849167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4433): Launched 16:11:01.149771 run iperf3-srv_10.42.42.10(pid=4434): Launched 16:11:01.295410 tst iperf3.py:8: start network... 16:11:01.530019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:02.064854 run create_hlr_db(pid=4435): Launched 16:11:02.232442 bus /gobi_6: Setting Powered False 16:11:03.297438 run create_hlr_db(pid=4435): Terminated: ok {rc=0} 16:11:03.759210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4437): Launched 16:11:04.092511 run osmo-hlr_10.42.42.2(pid=4438): Launched 16:11:04.221210 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:04.801061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4440): Launched 16:11:05.118952 run osmo-stp_10.42.42.5(pid=4441): Launched 16:11:05.237856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:05.776879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4443): Launched 16:11:05.896357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:06.161168 run patchelf(pid=4444): Launched 16:11:06.335121 run osmo-stp_10.42.42.5(pid=4441): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4441)] 16:11:06.467448 run osmo-stp_10.42.42.5(pid=4441): stdout: | (launched: 2022-12-13_16:11:05.060171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:06.601413 run osmo-stp_10.42.42.5(pid=4441): stderr: | [0;m[38;5;43m20221213161105233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161105233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161105234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161105234 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161105235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161105235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161105235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:06.735145 run osmo-stp_10.42.42.5(pid=4441): stdout: | (launched: 2022-12-13_16:11:05.060171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:06.862639 run osmo-stp_10.42.42.5(pid=4441): stderr: | [0;m[38;5;43m20221213161105233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161105233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161105234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161105234 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161105235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161105235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161105235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:07.013492 run patchelf(pid=4444): Terminating (SIGINT) 16:11:07.189260 run patchelf(pid=4444): Terminated: ok {rc=0} 16:11:07.315888 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4441): Process ended prematurely: osmo-stp_10.42.42.5(pid=4441) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4441)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 16:11:07.325471 tst iperf3.py:8: Test FAILED (7.8 sec) 16:11:07.352642 run osmo-hlr_10.42.42.2(pid=4438): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4438)] 16:11:07.400547 run osmo-hlr_10.42.42.2(pid=4438): stdout: | (launched: 2022-12-13_16:11:04.031354) 16:11:07.450767 run osmo-hlr_10.42.42.2(pid=4438): stderr: | [0;m[1;31m20221213161104228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161104229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161104229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161104229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161104229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161104229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161104240 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161104249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161104249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161104249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:07.500851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4433): Terminating (SIGTERM) 16:11:07.541126 run iperf3-srv_10.42.42.10(pid=4434): Terminating (SIGTERM) 16:11:07.580923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4437): Terminating (SIGTERM) 16:11:07.620861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4440): Terminating (SIGTERM) 16:11:07.660924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4443): Terminating (SIGTERM) 16:11:07.701209 --- ParallelTerminationStrategy: PID 4433 died... 16:11:07.720261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4433): Terminated: ok {rc=0} 16:11:07.764653 --- ParallelTerminationStrategy: PID 4434 died... 16:11:07.783224 run iperf3-srv_10.42.42.10(pid=4434): Terminated {rc=256} 16:11:07.827086 --- ParallelTerminationStrategy: PID 4437 died... 16:11:07.845737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4437): Terminated: ok {rc=0} 16:11:07.889475 --- ParallelTerminationStrategy: PID 4440 died... 16:11:07.908020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4440): Terminated: ok {rc=0} 16:11:07.951715 --- ParallelTerminationStrategy: PID 4443 died... 16:11:07.970405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4443): Terminated: ok {rc=0} 16:11:08.056558 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:11:09.204604 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:09.216660 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:11:09.269991 tst iperf3m4.py: using LAC 34748 16:11:09.392609 tst iperf3m4.py: using RAC 68 16:11:09.516217 tst iperf3m4.py: using CellId 34748 16:11:09.639804 tst iperf3m4.py: using BVCI 34749 16:11:09.754427 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:09.765632 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:09.776476 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:09.787404 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:09.798356 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:09.809372 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:09.820655 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:09.831483 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:09.842574 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:11:09.961333 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:11:10.085545 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:11:10.205947 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:11:10.328813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:11:10.554994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:10.891584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4445): Launched 16:11:11.184012 run iperf3-srv_10.42.42.10(pid=4446): Launched 16:11:11.311923 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:11:11.537829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:11.875328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4447): Launched 16:11:12.167906 run iperf3-srv_10.42.42.10(pid=4448): Launched 16:11:12.295366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:11:12.521170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:12.858705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4449): Launched 16:11:13.151315 run iperf3-srv_10.42.42.10(pid=4450): Launched 16:11:13.276741 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:11:13.501918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:13.839454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4451): Launched 16:11:14.132239 run iperf3-srv_10.42.42.10(pid=4452): Launched 16:11:14.260074 tst iperf3m4.py:8: start network... 16:11:14.486478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:15.007457 run create_hlr_db(pid=4453): Launched 16:11:15.136515 bus /gobi_6: Setting Powered False 16:11:16.220406 run create_hlr_db(pid=4453): Terminated: ok {rc=0} 16:11:16.759233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4455): Launched 16:11:17.095159 run osmo-hlr_10.42.42.2(pid=4456): Launched 16:11:17.303668 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:17.881290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4458): Launched 16:11:18.218744 run osmo-stp_10.42.42.5(pid=4459): Launched 16:11:18.349429 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:18.927009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4461): Launched 16:11:19.055555 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:19.338478 run patchelf(pid=4462): Launched 16:11:19.525944 run osmo-stp_10.42.42.5(pid=4459): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4459)] 16:11:19.667110 run osmo-stp_10.42.42.5(pid=4459): stdout: | (launched: 2022-12-13_16:11:18.156115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:19.809808 run osmo-stp_10.42.42.5(pid=4459): stderr: | [0;m[38;5;43m20221213161118345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161118346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161118346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161118346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161118347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161118347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161118347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:19.952771 run osmo-stp_10.42.42.5(pid=4459): stdout: | (launched: 2022-12-13_16:11:18.156115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:20.089077 run osmo-stp_10.42.42.5(pid=4459): stderr: | [0;m[38;5;43m20221213161118345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161118346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161118346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161118346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161118347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161118347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161118347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:20.250628 run patchelf(pid=4462): Terminating (SIGINT) 16:11:20.438009 run patchelf(pid=4462): Terminated: ok {rc=0} 16:11:20.573194 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4459): Process ended prematurely: osmo-stp_10.42.42.5(pid=4459) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4459)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 16:11:20.583785 tst iperf3m4.py:8: Test FAILED (11.4 sec) 16:11:20.613132 run osmo-hlr_10.42.42.2(pid=4456): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4456)] 16:11:20.664730 run osmo-hlr_10.42.42.2(pid=4456): stdout: | (launched: 2022-12-13_16:11:17.034889) 16:11:20.717500 run osmo-hlr_10.42.42.2(pid=4456): stderr: | [0;m[1;31m20221213161117318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161117318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161117318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161117318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161117318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161117318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161117331 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161117340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161117340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161117340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:20.770766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4445): Terminating (SIGTERM) 16:11:20.813246 run iperf3-srv_10.42.42.10(pid=4446): Terminating (SIGTERM) 16:11:20.856269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4447): Terminating (SIGTERM) 16:11:20.899101 run iperf3-srv_10.42.42.10(pid=4448): Terminating (SIGTERM) 16:11:20.941645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4449): Terminating (SIGTERM) 16:11:20.984661 run iperf3-srv_10.42.42.10(pid=4450): Terminating (SIGTERM) 16:11:21.026992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4451): Terminating (SIGTERM) 16:11:21.070146 run iperf3-srv_10.42.42.10(pid=4452): Terminating (SIGTERM) 16:11:21.113099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4455): Terminating (SIGTERM) 16:11:21.155728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4458): Terminating (SIGTERM) 16:11:21.198757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4461): Terminating (SIGTERM) 16:11:21.241680 --- ParallelTerminationStrategy: PID 4445 died... 16:11:21.262196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4445): Terminated: ok {rc=0} 16:11:21.309378 --- ParallelTerminationStrategy: PID 4446 died... 16:11:21.329386 run iperf3-srv_10.42.42.10(pid=4446): Terminated {rc=256} 16:11:21.376585 --- ParallelTerminationStrategy: PID 4447 died... 16:11:21.396722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4447): Terminated: ok {rc=0} 16:11:21.443402 --- ParallelTerminationStrategy: PID 4448 died... 16:11:21.463312 run iperf3-srv_10.42.42.10(pid=4448): Terminated {rc=256} 16:11:21.509696 --- ParallelTerminationStrategy: PID 4449 died... 16:11:21.529766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4449): Terminated: ok {rc=0} 16:11:21.576301 --- ParallelTerminationStrategy: PID 4450 died... 16:11:21.596274 run iperf3-srv_10.42.42.10(pid=4450): Terminated {rc=256} 16:11:21.643263 --- ParallelTerminationStrategy: PID 4451 died... 16:11:21.663275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4451): Terminated: ok {rc=0} 16:11:21.710021 --- ParallelTerminationStrategy: PID 4452 died... 16:11:21.729899 run iperf3-srv_10.42.42.10(pid=4452): Terminated {rc=256} 16:11:21.776288 --- ParallelTerminationStrategy: PID 4455 died... 16:11:21.796266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4455): Terminated: ok {rc=0} 16:11:21.842949 --- ParallelTerminationStrategy: PID 4458 died... 16:11:21.862992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4458): Terminated: ok {rc=0} 16:11:21.909589 --- ParallelTerminationStrategy: PID 4461 died... 16:11:21.929603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4461): Terminated: ok {rc=0} 16:11:22.018918 bus /gobi_4: Setting Powered False 16:11:23.118693 bus /gobi_4: Setting Powered False 16:11:24.236907 bus /gobi_1: Setting Powered False 16:11:25.335239 bus /gobi_1: Setting Powered False 16:11:26.452095 bus /gobi_0: Setting Powered False 16:11:27.548153 bus /gobi_0: Setting Powered False 16:11:28.665380 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 16:11:29.768524 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:29.780345 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:11:29.832456 tst ping.py: using LAC 34749 16:11:29.962015 tst ping.py: using RAC 69 16:11:30.095367 tst ping.py: using CellId 34749 16:11:30.222357 tst ping.py: using BVCI 34750 16:11:30.340881 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:30.352733 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:30.364461 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:30.375865 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:30.387560 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:30.399262 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:30.411280 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:30.423482 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:11:30.540932 tst ping.py:19: start network... 16:11:30.761081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:31.282971 run create_hlr_db(pid=4463): Launched 16:11:31.426134 bus /gobi_6: Setting Powered False 16:11:32.487276 run create_hlr_db(pid=4463): Terminated: ok {rc=0} 16:11:32.953109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4465): Launched 16:11:33.282782 run osmo-hlr_10.42.42.2(pid=4466): Launched 16:11:33.409859 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:33.981035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4468): Launched 16:11:34.311013 run osmo-stp_10.42.42.5(pid=4469): Launched 16:11:34.437552 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:35.006174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4471): Launched 16:11:35.134070 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:35.412197 run patchelf(pid=4472): Launched 16:11:35.596581 run osmo-stp_10.42.42.5(pid=4469): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4469)] 16:11:35.736020 run osmo-stp_10.42.42.5(pid=4469): stdout: | (launched: 2022-12-13_16:11:34.250102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:35.877267 run osmo-stp_10.42.42.5(pid=4469): stderr: | [0;m[38;5;43m20221213161134443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161134443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161134443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161134444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161134444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161134444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161134444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:36.018684 run osmo-stp_10.42.42.5(pid=4469): stdout: | (launched: 2022-12-13_16:11:34.250102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:36.153209 run osmo-stp_10.42.42.5(pid=4469): stderr: | [0;m[38;5;43m20221213161134443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161134443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161134443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161134444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161134444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161134444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161134444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:36.312675 run patchelf(pid=4472): Terminating (SIGINT) 16:11:36.497303 run patchelf(pid=4472): Terminated: ok {rc=0} 16:11:36.631183 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4469): Process ended prematurely: osmo-stp_10.42.42.5(pid=4469) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4469)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 16:11:36.640898 tst ping.py:22: Test FAILED (6.9 sec) 16:11:36.669940 run osmo-hlr_10.42.42.2(pid=4466): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4466)] 16:11:36.721721 run osmo-hlr_10.42.42.2(pid=4466): stdout: | (launched: 2022-12-13_16:11:33.221919) 16:11:36.774890 run osmo-hlr_10.42.42.2(pid=4466): stderr: | [0;m[1;31m20221213161133421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161133421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161133421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161133421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161133421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161133421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161133434 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161133443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161133443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161133443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:36.828673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4465): Terminating (SIGTERM) 16:11:36.871589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4468): Terminating (SIGTERM) 16:11:36.915065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4471): Terminating (SIGTERM) 16:11:36.958470 --- ParallelTerminationStrategy: PID 4465 died... 16:11:36.979427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4465): Terminated: ok {rc=0} 16:11:37.027027 --- ParallelTerminationStrategy: PID 4468 died... 16:11:37.047520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4468): Terminated: ok {rc=0} 16:11:37.094949 --- ParallelTerminationStrategy: PID 4471 died... 16:11:37.115401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4471): Terminated: ok {rc=0} 16:11:37.205947 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:11:38.294567 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:38.307063 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:11:38.363055 tst ping_idle_ping.py: using LAC 34750 16:11:38.492292 tst ping_idle_ping.py: using RAC 70 16:11:38.620251 tst ping_idle_ping.py: using CellId 34750 16:11:38.748835 tst ping_idle_ping.py: using BVCI 34751 16:11:38.867912 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:38.879572 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:38.890986 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:38.902407 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:38.914194 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:38.925883 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:38.937751 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:11:38.949415 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:11:39.071409 tst ping_idle_ping.py:24: start network... 16:11:39.292777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:39.803756 run create_hlr_db(pid=4473): Launched 16:11:39.931911 bus /gobi_6: Setting Powered False 16:11:40.996311 run create_hlr_db(pid=4473): Terminated: ok {rc=0} 16:11:41.437893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4475): Launched 16:11:41.748177 run osmo-hlr_10.42.42.2(pid=4476): Launched 16:11:41.866014 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:42.410677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4478): Launched 16:11:42.722537 run osmo-stp_10.42.42.5(pid=4479): Launched 16:11:42.841583 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:43.373758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4481): Launched 16:11:43.492747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:43.754779 run patchelf(pid=4482): Launched 16:11:43.928421 run osmo-stp_10.42.42.5(pid=4479): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4479)] 16:11:44.058518 run osmo-stp_10.42.42.5(pid=4479): stdout: | (launched: 2022-12-13_16:11:42.664085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:44.190677 run osmo-stp_10.42.42.5(pid=4479): stderr: | [0;m[38;5;43m20221213161142836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161142836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161142836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161142837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161142837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161142837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161142837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:44.322745 run osmo-stp_10.42.42.5(pid=4479): stdout: | (launched: 2022-12-13_16:11:42.664085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:44.448435 run osmo-stp_10.42.42.5(pid=4479): stderr: | [0;m[38;5;43m20221213161142836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161142836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161142836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161142837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161142837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161142837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161142837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:44.597395 run patchelf(pid=4482): Terminating (SIGINT) 16:11:44.770667 run patchelf(pid=4482): Terminated: ok {rc=0} 16:11:44.894752 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4479): Process ended prematurely: osmo-stp_10.42.42.5(pid=4479) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4479)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 16:11:44.903686 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:11:44.930645 run osmo-hlr_10.42.42.2(pid=4476): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4476)] 16:11:44.978281 run osmo-hlr_10.42.42.2(pid=4476): stdout: | (launched: 2022-12-13_16:11:41.690652) 16:11:45.027677 run osmo-hlr_10.42.42.2(pid=4476): stderr: | [0;m[1;31m20221213161141867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161141867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161141867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161141867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161141867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161141868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161141880 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161141888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161141888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161141888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:45.077585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4475): Terminating (SIGTERM) 16:11:45.117528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4478): Terminating (SIGTERM) 16:11:45.157442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4481): Terminating (SIGTERM) 16:11:45.197663 --- ParallelTerminationStrategy: PID 4475 died... 16:11:45.217063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4475): Terminated: ok {rc=0} 16:11:45.261431 --- ParallelTerminationStrategy: PID 4478 died... 16:11:45.280243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4478): Terminated: ok {rc=0} 16:11:45.325111 --- ParallelTerminationStrategy: PID 4481 died... 16:11:45.344166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4481): Terminated: ok {rc=0} 16:11:45.431522 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:11:46.750764 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:11:46.759301 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:11:46.802370 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:11:46.851542 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:11:46.944891 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:11:46.981159 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:11:47.022851 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:11:47.620666 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:11:47.673164 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:11:47.684446 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:11:47.756150 tst cs_paging_gprs_active.py: using LAC 34751 16:11:47.880287 tst cs_paging_gprs_active.py: using RAC 71 16:11:48.005161 tst cs_paging_gprs_active.py: using CellId 34751 16:11:48.129428 tst cs_paging_gprs_active.py: using BVCI 34752 16:11:48.243644 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:11:48.254851 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:11:48.265906 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:11:48.276799 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:11:48.287716 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:11:48.298615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:11:48.309713 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:11:48.320515 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:11:48.331523 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:11:48.454036 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:11:48.574737 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:11:48.784800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:49.097810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4486): Launched 16:11:49.370498 run iperf3-srv_10.42.42.10(pid=4487): Launched 16:11:49.489998 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:11:49.699471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:50.014498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4488): Launched 16:11:50.290292 run iperf3-srv_10.42.42.10(pid=4489): Launched 16:11:50.409897 tst cs_paging_gprs_active.py:38: start network... 16:11:50.619061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:51.104511 run create_hlr_db(pid=4490): Launched 16:11:51.232674 bus /gobi_6: Setting Powered False 16:11:52.297833 run create_hlr_db(pid=4490): Terminated: ok {rc=0} 16:11:52.763080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4492): Launched 16:11:53.099587 run osmo-hlr_10.42.42.2(pid=4493): Launched 16:11:53.229519 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:53.804214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4495): Launched 16:11:54.140752 run osmo-stp_10.42.42.5(pid=4496): Launched 16:11:54.269628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:54.845980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4498): Launched 16:11:54.976246 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:55.259489 run patchelf(pid=4499): Launched 16:11:55.447474 run osmo-stp_10.42.42.5(pid=4496): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4496)] 16:11:55.588772 run osmo-stp_10.42.42.5(pid=4496): stdout: | (launched: 2022-12-13_16:11:54.079151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:55.732258 run osmo-stp_10.42.42.5(pid=4496): stderr: | [0;m[38;5;43m20221213161154273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161154274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161154274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161154274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161154275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161154275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161154275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:55.874810 run osmo-stp_10.42.42.5(pid=4496): stdout: | (launched: 2022-12-13_16:11:54.079151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:56.011007 run osmo-stp_10.42.42.5(pid=4496): stderr: | [0;m[38;5;43m20221213161154273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161154274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161154274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161154274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161154275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161154275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161154275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:56.172688 run patchelf(pid=4499): Terminating (SIGINT) 16:11:56.359296 run patchelf(pid=4499): Terminated: ok {rc=0} 16:11:56.494161 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4496): Process ended prematurely: osmo-stp_10.42.42.5(pid=4496) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4496)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:11:56.504518 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:11:56.533455 run osmo-hlr_10.42.42.2(pid=4493): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4493)] 16:11:56.584593 run osmo-hlr_10.42.42.2(pid=4493): stdout: | (launched: 2022-12-13_16:11:53.038147) 16:11:56.636853 run osmo-hlr_10.42.42.2(pid=4493): stderr: | [0;m[1;31m20221213161153238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161153238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161153238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161153238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161153238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161153238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161153251 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161153261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161153261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161153261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:56.690568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4486): Terminating (SIGTERM) 16:11:56.733157 run iperf3-srv_10.42.42.10(pid=4487): Terminating (SIGTERM) 16:11:56.776375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4488): Terminating (SIGTERM) 16:11:56.820108 run iperf3-srv_10.42.42.10(pid=4489): Terminating (SIGTERM) 16:11:56.862678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4492): Terminating (SIGTERM) 16:11:56.905135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4495): Terminating (SIGTERM) 16:11:56.947569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4498): Terminating (SIGTERM) 16:11:56.990312 --- ParallelTerminationStrategy: PID 4486 died... 16:11:57.010345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4486): Terminated: ok {rc=0} 16:11:57.057121 --- ParallelTerminationStrategy: PID 4487 died... 16:11:57.076990 run iperf3-srv_10.42.42.10(pid=4487): Terminated {rc=256} 16:11:57.123117 --- ParallelTerminationStrategy: PID 4488 died... 16:11:57.142931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4488): Terminated: ok {rc=0} 16:11:57.189131 --- ParallelTerminationStrategy: PID 4489 died... 16:11:57.208723 run iperf3-srv_10.42.42.10(pid=4489): Terminated {rc=256} 16:11:57.254746 --- ParallelTerminationStrategy: PID 4492 died... 16:11:57.274597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4492): Terminated: ok {rc=0} 16:11:57.320790 --- ParallelTerminationStrategy: PID 4495 died... 16:11:57.341196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4495): Terminated: ok {rc=0} 16:11:57.387360 --- ParallelTerminationStrategy: PID 4498 died... 16:11:57.407239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4498): Terminated: ok {rc=0} 16:11:57.495827 bus /gobi_0: Setting Powered False 16:11:58.595605 bus /gobi_0: Setting Powered False 16:11:59.712622 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:12:00.869889 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:00.883369 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:12:00.973752 tst iperf3.py: using LAC 34752 16:12:01.134619 tst iperf3.py: using RAC 72 16:12:01.307966 tst iperf3.py: using CellId 34752 16:12:01.441458 tst iperf3.py: using BVCI 34753 16:12:01.566826 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:01.579996 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:01.593217 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:01.605787 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:01.619240 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:01.632840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:01.650822 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:01.665088 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:01.678862 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:12:01.804735 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:12:02.051165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:02.423216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4500): Launched 16:12:02.697646 run iperf3-srv_10.42.42.10(pid=4501): Launched 16:12:02.815225 tst iperf3.py:8: start network... 16:12:03.023512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:03.530484 run create_hlr_db(pid=4502): Launched 16:12:03.661255 bus /gobi_6: Setting Powered False 16:12:04.727416 run create_hlr_db(pid=4502): Terminated: ok {rc=0} 16:12:05.191781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4504): Launched 16:12:05.528253 run osmo-hlr_10.42.42.2(pid=4505): Launched 16:12:05.658431 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:06.242247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4507): Launched 16:12:06.577815 run osmo-stp_10.42.42.5(pid=4508): Launched 16:12:06.706599 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:07.282625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4510): Launched 16:12:07.411264 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:07.695309 run patchelf(pid=4511): Launched 16:12:07.881739 run osmo-stp_10.42.42.5(pid=4508): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4508)] 16:12:08.022803 run osmo-stp_10.42.42.5(pid=4508): stdout: | (launched: 2022-12-13_16:12:06.516193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:08.165699 run osmo-stp_10.42.42.5(pid=4508): stderr: | [0;m[38;5;43m20221213161206710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161206710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161206711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161206711 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161206712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161206712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161206712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:08.308816 run osmo-stp_10.42.42.5(pid=4508): stdout: | (launched: 2022-12-13_16:12:06.516193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:08.445408 run osmo-stp_10.42.42.5(pid=4508): stderr: | [0;m[38;5;43m20221213161206710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161206710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161206711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161206711 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161206712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161206712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161206712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:08.607201 run patchelf(pid=4511): Terminating (SIGINT) 16:12:08.795129 run patchelf(pid=4511): Terminated: ok {rc=0} 16:12:08.930986 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4508): Process ended prematurely: osmo-stp_10.42.42.5(pid=4508) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4508)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 16:12:08.941399 tst iperf3.py:8: Test FAILED (8.1 sec) 16:12:08.970130 run osmo-hlr_10.42.42.2(pid=4505): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4505)] 16:12:09.021248 run osmo-hlr_10.42.42.2(pid=4505): stdout: | (launched: 2022-12-13_16:12:05.466533) 16:12:09.073835 run osmo-hlr_10.42.42.2(pid=4505): stderr: | [0;m[1;31m20221213161205666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161205666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161205666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161205666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161205666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161205666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161205679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161205690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161205690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161205690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:09.126099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4500): Terminating (SIGTERM) 16:12:09.168596 run iperf3-srv_10.42.42.10(pid=4501): Terminating (SIGTERM) 16:12:09.212683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4504): Terminating (SIGTERM) 16:12:09.255579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4507): Terminating (SIGTERM) 16:12:09.297918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4510): Terminating (SIGTERM) 16:12:09.341207 --- ParallelTerminationStrategy: PID 4500 died... 16:12:09.361650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4500): Terminated: ok {rc=0} 16:12:09.408315 --- ParallelTerminationStrategy: PID 4501 died... 16:12:09.428281 run iperf3-srv_10.42.42.10(pid=4501): Terminated {rc=256} 16:12:09.474381 --- ParallelTerminationStrategy: PID 4504 died... 16:12:09.494524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4504): Terminated: ok {rc=0} 16:12:09.541180 --- ParallelTerminationStrategy: PID 4507 died... 16:12:09.561313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4507): Terminated: ok {rc=0} 16:12:09.607924 --- ParallelTerminationStrategy: PID 4510 died... 16:12:09.627959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4510): Terminated: ok {rc=0} 16:12:09.716637 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:12:10.869459 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:10.882196 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:12:10.956837 tst iperf3m4.py: using LAC 34753 16:12:11.088808 tst iperf3m4.py: using RAC 73 16:12:11.220738 tst iperf3m4.py: using CellId 34753 16:12:11.352569 tst iperf3m4.py: using BVCI 34754 16:12:11.474102 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:11.485916 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:11.497331 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:11.508641 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:11.520999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:11.533217 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:11.545577 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:11.557781 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:11.570876 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:12:11.696217 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:12:11.818530 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:12:11.942117 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:12:12.062526 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:12:12.272229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:12.587885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4512): Launched 16:12:12.862827 run iperf3-srv_10.42.42.10(pid=4513): Launched 16:12:12.983488 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:12:13.192585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:13.507748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4514): Launched 16:12:13.782052 run iperf3-srv_10.42.42.10(pid=4515): Launched 16:12:13.901254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:12:14.109450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:14.424091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4516): Launched 16:12:14.698714 run iperf3-srv_10.42.42.10(pid=4517): Launched 16:12:14.816295 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:12:15.026070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:15.341579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4518): Launched 16:12:15.615221 run iperf3-srv_10.42.42.10(pid=4519): Launched 16:12:15.734625 tst iperf3m4.py:8: start network... 16:12:15.958657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:16.463955 run create_hlr_db(pid=4520): Launched 16:12:16.652003 bus /gobi_6: Setting Powered False 16:12:17.717032 run create_hlr_db(pid=4520): Terminated: ok {rc=0} 16:12:18.177704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4522): Launched 16:12:18.491281 run osmo-hlr_10.42.42.2(pid=4523): Launched 16:12:18.610585 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:19.165575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4525): Launched 16:12:19.480715 run osmo-stp_10.42.42.5(pid=4526): Launched 16:12:19.601223 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:20.137818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4528): Launched 16:12:20.258503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:20.522099 run patchelf(pid=4529): Launched 16:12:20.696121 run osmo-stp_10.42.42.5(pid=4526): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4526)] 16:12:20.827730 run osmo-stp_10.42.42.5(pid=4526): stdout: | (launched: 2022-12-13_16:12:19.422418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:20.962294 run osmo-stp_10.42.42.5(pid=4526): stderr: | [0;m[38;5;43m20221213161219593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161219593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161219594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161219594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161219595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161219595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161219595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:21.095629 run osmo-stp_10.42.42.5(pid=4526): stdout: | (launched: 2022-12-13_16:12:19.422418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:21.223213 run osmo-stp_10.42.42.5(pid=4526): stderr: | [0;m[38;5;43m20221213161219593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161219593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161219594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161219594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161219595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161219595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161219595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:21.374103 run patchelf(pid=4529): Terminating (SIGINT) 16:12:21.549423 run patchelf(pid=4529): Terminated: ok {rc=0} 16:12:21.676036 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4526): Process ended prematurely: osmo-stp_10.42.42.5(pid=4526) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4526)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:12:21.685781 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:12:21.713525 run osmo-hlr_10.42.42.2(pid=4523): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4523)] 16:12:21.761515 run osmo-hlr_10.42.42.2(pid=4523): stdout: | (launched: 2022-12-13_16:12:18.433101) 16:12:21.811057 run osmo-hlr_10.42.42.2(pid=4523): stderr: | [0;m[1;31m20221213161218609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161218609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161218609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161218609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161218609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161218609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161218622 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161218630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161218630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161218630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:21.861527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4512): Terminating (SIGTERM) 16:12:21.901619 run iperf3-srv_10.42.42.10(pid=4513): Terminating (SIGTERM) 16:12:21.941606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4514): Terminating (SIGTERM) 16:12:21.981906 run iperf3-srv_10.42.42.10(pid=4515): Terminating (SIGTERM) 16:12:22.022145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4516): Terminating (SIGTERM) 16:12:22.062430 run iperf3-srv_10.42.42.10(pid=4517): Terminating (SIGTERM) 16:12:22.102485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4518): Terminating (SIGTERM) 16:12:22.142598 run iperf3-srv_10.42.42.10(pid=4519): Terminating (SIGTERM) 16:12:22.182548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4522): Terminating (SIGTERM) 16:12:22.222725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4525): Terminating (SIGTERM) 16:12:22.262807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4528): Terminating (SIGTERM) 16:12:22.303351 --- ParallelTerminationStrategy: PID 4512 died... 16:12:22.322754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4512): Terminated: ok {rc=0} 16:12:22.367283 --- ParallelTerminationStrategy: PID 4513 died... 16:12:22.386120 run iperf3-srv_10.42.42.10(pid=4513): Terminated {rc=256} 16:12:22.430071 --- ParallelTerminationStrategy: PID 4514 died... 16:12:22.448746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4514): Terminated: ok {rc=0} 16:12:22.492670 --- ParallelTerminationStrategy: PID 4515 died... 16:12:22.511507 run iperf3-srv_10.42.42.10(pid=4515): Terminated {rc=256} 16:12:22.555364 --- ParallelTerminationStrategy: PID 4516 died... 16:12:22.574550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4516): Terminated: ok {rc=0} 16:12:22.618476 --- ParallelTerminationStrategy: PID 4517 died... 16:12:22.637081 run iperf3-srv_10.42.42.10(pid=4517): Terminated {rc=256} 16:12:22.680792 --- ParallelTerminationStrategy: PID 4518 died... 16:12:22.699527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4518): Terminated: ok {rc=0} 16:12:22.743626 --- ParallelTerminationStrategy: PID 4519 died... 16:12:22.762448 run iperf3-srv_10.42.42.10(pid=4519): Terminated {rc=256} 16:12:22.806418 --- ParallelTerminationStrategy: PID 4522 died... 16:12:22.825388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4522): Terminated: ok {rc=0} 16:12:22.869552 --- ParallelTerminationStrategy: PID 4525 died... 16:12:22.888332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4525): Terminated: ok {rc=0} 16:12:22.932502 --- ParallelTerminationStrategy: PID 4528 died... 16:12:22.951405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4528): Terminated: ok {rc=0} 16:12:23.038612 bus /gobi_4: Setting Powered False 16:12:24.139751 bus /gobi_4: Setting Powered False 16:12:25.255268 bus /gobi_1: Setting Powered False 16:12:26.355016 bus /gobi_1: Setting Powered False 16:12:27.472757 bus /gobi_0: Setting Powered False 16:12:28.572146 bus /gobi_0: Setting Powered False 16:12:29.691579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:12:30.799214 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:30.811842 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:12:30.919697 tst ping.py: using LAC 34754 16:12:31.046739 tst ping.py: using RAC 74 16:12:31.170046 tst ping.py: using CellId 34754 16:12:31.294162 tst ping.py: using BVCI 34755 16:12:31.415138 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:31.427120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:31.439021 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:31.451143 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:31.464838 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:31.478915 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:31.493882 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:31.507817 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:12:31.635196 tst ping.py:19: start network... 16:12:31.867622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:32.382758 run create_hlr_db(pid=4530): Launched 16:12:32.509820 bus /gobi_6: Setting Powered False 16:12:33.570970 run create_hlr_db(pid=4530): Terminated: ok {rc=0} 16:12:34.001062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4532): Launched 16:12:34.310036 run osmo-hlr_10.42.42.2(pid=4533): Launched 16:12:34.427581 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:34.973912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4535): Launched 16:12:35.282995 run osmo-stp_10.42.42.5(pid=4536): Launched 16:12:35.400198 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:35.930254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4538): Launched 16:12:36.049847 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:36.310538 run patchelf(pid=4539): Launched 16:12:36.482970 run osmo-stp_10.42.42.5(pid=4536): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4536)] 16:12:36.612643 run osmo-stp_10.42.42.5(pid=4536): stdout: | (launched: 2022-12-13_16:12:35.225427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:36.744593 run osmo-stp_10.42.42.5(pid=4536): stderr: | [0;m[38;5;43m20221213161235396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161235397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161235397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161235397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161235398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161235398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161235398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:36.876394 run osmo-stp_10.42.42.5(pid=4536): stdout: | (launched: 2022-12-13_16:12:35.225427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:37.001957 run osmo-stp_10.42.42.5(pid=4536): stderr: | [0;m[38;5;43m20221213161235396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161235397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161235397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161235397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161235398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161235398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161235398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:37.151534 run patchelf(pid=4539): Terminating (SIGINT) 16:12:37.323401 run patchelf(pid=4539): Terminated: ok {rc=0} 16:12:37.448172 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4536): Process ended prematurely: osmo-stp_10.42.42.5(pid=4536) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4536)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 16:12:37.457455 tst ping.py:22: Test FAILED (6.7 sec) 16:12:37.484750 run osmo-hlr_10.42.42.2(pid=4533): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4533)] 16:12:37.533075 run osmo-hlr_10.42.42.2(pid=4533): stdout: | (launched: 2022-12-13_16:12:34.252307) 16:12:37.582881 run osmo-hlr_10.42.42.2(pid=4533): stderr: | [0;m[1;31m20221213161234429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161234429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161234429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161234429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161234429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161234429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161234442 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161234450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161234450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161234450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:37.633368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4532): Terminating (SIGTERM) 16:12:37.673537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4535): Terminating (SIGTERM) 16:12:37.713709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4538): Terminating (SIGTERM) 16:12:37.754312 --- ParallelTerminationStrategy: PID 4532 died... 16:12:37.773251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4532): Terminated: ok {rc=0} 16:12:37.817632 --- ParallelTerminationStrategy: PID 4535 died... 16:12:37.836632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4535): Terminated: ok {rc=0} 16:12:37.880913 --- ParallelTerminationStrategy: PID 4538 died... 16:12:37.899892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4538): Terminated: ok {rc=0} 16:12:37.984547 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:12:39.072252 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:39.085180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:12:39.163871 tst ping_idle_ping.py: using LAC 34755 16:12:39.291475 tst ping_idle_ping.py: using RAC 75 16:12:39.418302 tst ping_idle_ping.py: using CellId 34755 16:12:39.538916 tst ping_idle_ping.py: using BVCI 34756 16:12:39.650887 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:39.662243 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:39.673791 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:39.684775 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:39.695936 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:39.707034 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:39.718295 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:12:39.729441 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:12:39.851383 tst ping_idle_ping.py:24: start network... 16:12:40.072909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:40.590297 run create_hlr_db(pid=4540): Launched 16:12:40.717638 bus /gobi_6: Setting Powered False 16:12:41.782699 run create_hlr_db(pid=4540): Terminated: ok {rc=0} 16:12:42.223929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4542): Launched 16:12:42.533821 run osmo-hlr_10.42.42.2(pid=4543): Launched 16:12:42.651277 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:43.194674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4545): Launched 16:12:43.504185 run osmo-stp_10.42.42.5(pid=4546): Launched 16:12:43.621421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:44.151642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4548): Launched 16:12:44.270470 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:44.530523 run patchelf(pid=4549): Launched 16:12:44.701944 run osmo-stp_10.42.42.5(pid=4546): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4546)] 16:12:44.831813 run osmo-stp_10.42.42.5(pid=4546): stdout: | (launched: 2022-12-13_16:12:43.446779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:44.963766 run osmo-stp_10.42.42.5(pid=4546): stderr: | [0;m[38;5;43m20221213161243619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161243619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161243619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161243620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161243620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161243620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161243620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:45.095635 run osmo-stp_10.42.42.5(pid=4546): stdout: | (launched: 2022-12-13_16:12:43.446779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:45.221907 run osmo-stp_10.42.42.5(pid=4546): stderr: | [0;m[38;5;43m20221213161243619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161243619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161243619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161243620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161243620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161243620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161243620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:45.370779 run patchelf(pid=4549): Terminating (SIGINT) 16:12:45.542770 run patchelf(pid=4549): Terminated: ok {rc=0} 16:12:45.666995 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4546): Process ended prematurely: osmo-stp_10.42.42.5(pid=4546) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4546)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:12:45.676054 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:12:45.703468 run osmo-hlr_10.42.42.2(pid=4543): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4543)] 16:12:45.751470 run osmo-hlr_10.42.42.2(pid=4543): stdout: | (launched: 2022-12-13_16:12:42.476144) 16:12:45.801178 run osmo-hlr_10.42.42.2(pid=4543): stderr: | [0;m[1;31m20221213161242653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161242653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161242653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161242653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161242653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161242653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161242666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161242677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161242677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161242677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:45.856306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4542): Terminating (SIGTERM) 16:12:45.916317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4545): Terminating (SIGTERM) 16:12:45.958209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4548): Terminating (SIGTERM) 16:12:45.999971 --- ParallelTerminationStrategy: PID 4542 died... 16:12:46.019534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4542): Terminated: ok {rc=0} 16:12:46.071905 --- ParallelTerminationStrategy: PID 4545 died... 16:12:46.090992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4545): Terminated: ok {rc=0} 16:12:46.136494 --- ParallelTerminationStrategy: PID 4548 died... 16:12:46.155912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4548): Terminated: ok {rc=0} 16:12:46.245467 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:12:47.563292 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:47.571493 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:12:47.607512 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:12:47.647738 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:12:47.738753 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:12:47.773631 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:12:47.813493 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:12:48.411243 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:12:48.465384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:48.477491 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:12:48.550968 tst cs_paging_gprs_active.py: using LAC 34756 16:12:48.681952 tst cs_paging_gprs_active.py: using RAC 76 16:12:48.819166 tst cs_paging_gprs_active.py: using CellId 34756 16:12:48.948256 tst cs_paging_gprs_active.py: using BVCI 34757 16:12:49.069118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:49.080726 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:49.092308 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:49.103799 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:49.115596 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:49.127278 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:49.139146 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:49.150782 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:49.162771 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:12:49.285419 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:12:49.409238 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:12:49.635270 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:49.971889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4553): Launched 16:12:50.264798 run iperf3-srv_10.42.42.10(pid=4554): Launched 16:12:50.392006 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:12:50.617337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:50.954742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4555): Launched 16:12:51.247908 run iperf3-srv_10.42.42.10(pid=4556): Launched 16:12:51.373526 tst cs_paging_gprs_active.py:38: start network... 16:12:51.599640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:52.118407 run create_hlr_db(pid=4557): Launched 16:12:52.246161 bus /gobi_6: Setting Powered False 16:12:53.311361 run create_hlr_db(pid=4557): Terminated: ok {rc=0} 16:12:53.758473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4559): Launched 16:12:54.074121 run osmo-hlr_10.42.42.2(pid=4560): Launched 16:12:54.193463 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:54.730974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4562): Launched 16:12:55.046634 run osmo-stp_10.42.42.5(pid=4563): Launched 16:12:55.168332 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:55.710035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4565): Launched 16:12:55.831456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:56.096559 run patchelf(pid=4566): Launched 16:12:56.272027 run osmo-stp_10.42.42.5(pid=4563): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4563)] 16:12:56.404286 run osmo-stp_10.42.42.5(pid=4563): stdout: | (launched: 2022-12-13_16:12:54.988221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:56.538006 run osmo-stp_10.42.42.5(pid=4563): stderr: | [0;m[38;5;43m20221213161255160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161255160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161255160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161255161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161255161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161255161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161255161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:56.671569 run osmo-stp_10.42.42.5(pid=4563): stdout: | (launched: 2022-12-13_16:12:54.988221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:56.798896 run osmo-stp_10.42.42.5(pid=4563): stderr: | [0;m[38;5;43m20221213161255160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161255160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161255160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161255161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161255161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161255161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161255161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:56.949796 run patchelf(pid=4566): Terminating (SIGINT) 16:12:57.125582 run patchelf(pid=4566): Terminated: ok {rc=0} 16:12:57.253109 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4563): Process ended prematurely: osmo-stp_10.42.42.5(pid=4563) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4563)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:12:57.262860 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:12:57.290374 run osmo-hlr_10.42.42.2(pid=4560): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4560)] 16:12:57.338607 run osmo-hlr_10.42.42.2(pid=4560): stdout: | (launched: 2022-12-13_16:12:54.015474) 16:12:57.388534 run osmo-hlr_10.42.42.2(pid=4560): stderr: | [0;m[1;31m20221213161254194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161254194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161254194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161254194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161254194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161254194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161254206 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161254215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161254215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161254215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:57.439104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4553): Terminating (SIGTERM) 16:12:57.479588 run iperf3-srv_10.42.42.10(pid=4554): Terminating (SIGTERM) 16:12:57.519892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4555): Terminating (SIGTERM) 16:12:57.560062 run iperf3-srv_10.42.42.10(pid=4556): Terminating (SIGTERM) 16:12:57.600168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4559): Terminating (SIGTERM) 16:12:57.640379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4562): Terminating (SIGTERM) 16:12:57.680534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4565): Terminating (SIGTERM) 16:12:57.721034 --- ParallelTerminationStrategy: PID 4553 died... 16:12:57.740413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4553): Terminated: ok {rc=0} 16:12:57.784858 --- ParallelTerminationStrategy: PID 4554 died... 16:12:57.803768 run iperf3-srv_10.42.42.10(pid=4554): Terminated {rc=256} 16:12:57.847734 --- ParallelTerminationStrategy: PID 4555 died... 16:12:57.866972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4555): Terminated: ok {rc=0} 16:12:57.910778 --- ParallelTerminationStrategy: PID 4556 died... 16:12:57.929478 run iperf3-srv_10.42.42.10(pid=4556): Terminated {rc=256} 16:12:57.973350 --- ParallelTerminationStrategy: PID 4559 died... 16:12:57.991976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4559): Terminated: ok {rc=0} 16:12:58.036249 --- ParallelTerminationStrategy: PID 4562 died... 16:12:58.055141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4562): Terminated: ok {rc=0} 16:12:58.099481 --- ParallelTerminationStrategy: PID 4565 died... 16:12:58.118250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4565): Terminated: ok {rc=0} 16:12:58.204318 bus /gobi_0: Setting Powered False 16:12:59.302788 bus /gobi_0: Setting Powered False 16:13:00.419035 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:13:01.590163 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:01.604765 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:13:01.694084 tst iperf3.py: using LAC 34757 16:13:01.850500 tst iperf3.py: using RAC 77 16:13:01.987822 tst iperf3.py: using CellId 34757 16:13:02.122842 tst iperf3.py: using BVCI 34758 16:13:02.240872 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:02.252277 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:02.263321 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:02.274817 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:02.286271 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:02.297283 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:02.308213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:02.319072 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:02.330084 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:13:02.447094 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:13:02.656922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:02.972489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4567): Launched 16:13:03.246881 run iperf3-srv_10.42.42.10(pid=4568): Launched 16:13:03.367376 tst iperf3.py:8: start network... 16:13:03.576893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:04.063149 run create_hlr_db(pid=4569): Launched 16:13:04.193632 bus /gobi_6: Setting Powered False 16:13:05.254353 run create_hlr_db(pid=4569): Terminated: ok {rc=0} 16:13:05.711031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4571): Launched 16:13:06.047637 run osmo-hlr_10.42.42.2(pid=4572): Launched 16:13:06.176575 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:06.753547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4574): Launched 16:13:07.089605 run osmo-stp_10.42.42.5(pid=4575): Launched 16:13:07.216325 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:13:07.792788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4577): Launched 16:13:07.922402 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:13:08.206027 run patchelf(pid=4578): Launched 16:13:08.393775 run osmo-stp_10.42.42.5(pid=4575): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4575)] 16:13:08.534506 run osmo-stp_10.42.42.5(pid=4575): stdout: | (launched: 2022-12-13_16:13:07.027771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:08.677440 run osmo-stp_10.42.42.5(pid=4575): stderr: | [0;m[38;5;43m20221213161307221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161307221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161307222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161307222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161307222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161307222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161307223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:08.821516 run osmo-stp_10.42.42.5(pid=4575): stdout: | (launched: 2022-12-13_16:13:07.027771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:08.957686 run osmo-stp_10.42.42.5(pid=4575): stderr: | [0;m[38;5;43m20221213161307221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161307221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161307222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161307222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161307222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161307222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161307223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:09.119655 run patchelf(pid=4578): Terminating (SIGINT) 16:13:09.307311 run patchelf(pid=4578): Terminated: ok {rc=0} 16:13:09.442660 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4575): Process ended prematurely: osmo-stp_10.42.42.5(pid=4575) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4575)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 16:13:09.453109 tst iperf3.py:8: Test FAILED (7.9 sec) 16:13:09.482093 run osmo-hlr_10.42.42.2(pid=4572): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4572)] 16:13:09.533121 run osmo-hlr_10.42.42.2(pid=4572): stdout: | (launched: 2022-12-13_16:13:05.986130) 16:13:09.585328 run osmo-hlr_10.42.42.2(pid=4572): stderr: | [0;m[1;31m20221213161306185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161306185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161306185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161306185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161306185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161306185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161306198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161306206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161306206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161306207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:09.638413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4567): Terminating (SIGTERM) 16:13:09.681087 run iperf3-srv_10.42.42.10(pid=4568): Terminating (SIGTERM) 16:13:09.724352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4571): Terminating (SIGTERM) 16:13:09.767184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4574): Terminating (SIGTERM) 16:13:09.809853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4577): Terminating (SIGTERM) 16:13:09.852436 --- ParallelTerminationStrategy: PID 4567 died... 16:13:09.873214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4567): Terminated: ok {rc=0} 16:13:09.920133 --- ParallelTerminationStrategy: PID 4568 died... 16:13:09.940272 run iperf3-srv_10.42.42.10(pid=4568): Terminated {rc=256} 16:13:09.986928 --- ParallelTerminationStrategy: PID 4571 died... 16:13:10.007074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4571): Terminated: ok {rc=0} 16:13:10.053742 --- ParallelTerminationStrategy: PID 4574 died... 16:13:10.073916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4574): Terminated: ok {rc=0} 16:13:10.120372 --- ParallelTerminationStrategy: PID 4577 died... 16:13:10.140360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4577): Terminated: ok {rc=0} 16:13:10.228927 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:13:11.382511 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:11.395184 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:13:11.470388 tst iperf3m4.py: using LAC 34758 16:13:11.601729 tst iperf3m4.py: using RAC 78 16:13:11.732317 tst iperf3m4.py: using CellId 34758 16:13:11.863336 tst iperf3m4.py: using BVCI 34759 16:13:11.984248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:11.996233 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:12.008030 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:12.019581 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:12.031378 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:12.043399 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:12.055565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:12.067554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:12.079743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:13:12.201638 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:13:12.327680 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:13:12.448572 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:13:12.566615 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:13:12.777406 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:13.093805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4579): Launched 16:13:13.368856 run iperf3-srv_10.42.42.10(pid=4580): Launched 16:13:13.488135 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:13:13.697249 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:14.011745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4581): Launched 16:13:14.286057 run iperf3-srv_10.42.42.10(pid=4582): Launched 16:13:14.405211 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:13:14.614213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:14.928148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4583): Launched 16:13:15.204051 run iperf3-srv_10.42.42.10(pid=4584): Launched 16:13:15.323729 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:13:15.533487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:15.861737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4585): Launched 16:13:16.203462 run iperf3-srv_10.42.42.10(pid=4586): Launched 16:13:16.341480 tst iperf3m4.py:8: start network... 16:13:16.558346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:17.059939 run create_hlr_db(pid=4587): Launched 16:13:17.227001 bus /gobi_6: Setting Powered False 16:13:18.288304 run create_hlr_db(pid=4587): Terminated: ok {rc=0} 16:13:18.723142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4589): Launched 16:13:19.037255 run osmo-hlr_10.42.42.2(pid=4590): Launched 16:13:19.155413 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:19.707545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4592): Launched 16:13:20.022556 run osmo-stp_10.42.42.5(pid=4593): Launched 16:13:20.142369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:13:20.678970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4595): Launched 16:13:20.800256 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:13:21.064872 run patchelf(pid=4596): Launched 16:13:21.238856 run osmo-stp_10.42.42.5(pid=4593): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4593)] 16:13:21.370361 run osmo-stp_10.42.42.5(pid=4593): stdout: | (launched: 2022-12-13_16:13:19.964089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:21.504800 run osmo-stp_10.42.42.5(pid=4593): stderr: | [0;m[38;5;43m20221213161320132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161320132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161320132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161320133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161320133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161320133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161320133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:21.639002 run osmo-stp_10.42.42.5(pid=4593): stdout: | (launched: 2022-12-13_16:13:19.964089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:21.766862 run osmo-stp_10.42.42.5(pid=4593): stderr: | [0;m[38;5;43m20221213161320132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161320132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161320132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161320133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161320133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161320133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161320133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:21.918360 run patchelf(pid=4596): Terminating (SIGINT) 16:13:22.093838 run patchelf(pid=4596): Terminated: ok {rc=0} 16:13:22.220156 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4593): Process ended prematurely: osmo-stp_10.42.42.5(pid=4593) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4593)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:13:22.229954 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:13:22.257912 run osmo-hlr_10.42.42.2(pid=4590): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4590)] 16:13:22.306165 run osmo-hlr_10.42.42.2(pid=4590): stdout: | (launched: 2022-12-13_16:13:18.978145) 16:13:22.356578 run osmo-hlr_10.42.42.2(pid=4590): stderr: | [0;m[1;31m20221213161319153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161319153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161319153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161319153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161319153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161319154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161319166 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161319174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161319174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161319174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:22.407203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4579): Terminating (SIGTERM) 16:13:22.447527 run iperf3-srv_10.42.42.10(pid=4580): Terminating (SIGTERM) 16:13:22.487799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4581): Terminating (SIGTERM) 16:13:22.527959 run iperf3-srv_10.42.42.10(pid=4582): Terminating (SIGTERM) 16:13:22.568042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4583): Terminating (SIGTERM) 16:13:22.608179 run iperf3-srv_10.42.42.10(pid=4584): Terminating (SIGTERM) 16:13:22.648212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4585): Terminating (SIGTERM) 16:13:22.688282 run iperf3-srv_10.42.42.10(pid=4586): Terminating (SIGTERM) 16:13:22.728234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4589): Terminating (SIGTERM) 16:13:22.768401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4592): Terminating (SIGTERM) 16:13:22.808611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4595): Terminating (SIGTERM) 16:13:22.849450 --- ParallelTerminationStrategy: PID 4579 died... 16:13:22.868607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4579): Terminated: ok {rc=0} 16:13:22.913079 --- ParallelTerminationStrategy: PID 4580 died... 16:13:22.931769 run iperf3-srv_10.42.42.10(pid=4580): Terminated {rc=256} 16:13:22.975625 --- ParallelTerminationStrategy: PID 4581 died... 16:13:22.994358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4581): Terminated: ok {rc=0} 16:13:23.038585 --- ParallelTerminationStrategy: PID 4582 died... 16:13:23.057320 run iperf3-srv_10.42.42.10(pid=4582): Terminated {rc=256} 16:13:23.101193 --- ParallelTerminationStrategy: PID 4583 died... 16:13:23.119967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4583): Terminated: ok {rc=0} 16:13:23.164117 --- ParallelTerminationStrategy: PID 4584 died... 16:13:23.182839 run iperf3-srv_10.42.42.10(pid=4584): Terminated {rc=256} 16:13:23.226632 --- ParallelTerminationStrategy: PID 4585 died... 16:13:23.245571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4585): Terminated: ok {rc=0} 16:13:23.289903 --- ParallelTerminationStrategy: PID 4586 died... 16:13:23.308587 run iperf3-srv_10.42.42.10(pid=4586): Terminated {rc=256} 16:13:23.352470 --- ParallelTerminationStrategy: PID 4589 died... 16:13:23.371310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4589): Terminated: ok {rc=0} 16:13:23.415318 --- ParallelTerminationStrategy: PID 4592 died... 16:13:23.434282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4592): Terminated: ok {rc=0} 16:13:23.478582 --- ParallelTerminationStrategy: PID 4595 died... 16:13:23.497495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4595): Terminated: ok {rc=0} 16:13:23.584550 bus /gobi_4: Setting Powered False 16:13:24.686181 bus /gobi_4: Setting Powered False 16:13:25.803337 bus /gobi_1: Setting Powered False 16:13:26.902710 bus /gobi_1: Setting Powered False 16:13:28.022527 bus /gobi_0: Setting Powered False 16:13:29.122949 bus /gobi_0: Setting Powered False 16:13:30.238967 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:13:31.357407 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:31.374703 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:13:31.465349 tst ping.py: using LAC 34759 16:13:31.633530 tst ping.py: using RAC 79 16:13:31.765067 tst ping.py: using CellId 34759 16:13:31.912034 tst ping.py: using BVCI 34760 16:13:32.061539 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:32.077054 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:32.093251 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:32.107810 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:32.119854 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:32.132155 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:32.144805 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:32.157626 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:13:32.283177 tst ping.py:19: start network... 16:13:32.504746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:33.012035 run create_hlr_db(pid=4597): Launched 16:13:33.140001 bus /gobi_6: Setting Powered False 16:13:34.204687 run create_hlr_db(pid=4597): Terminated: ok {rc=0} 16:13:34.643982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4599): Launched 16:13:34.953561 run osmo-hlr_10.42.42.2(pid=4600): Launched 16:13:35.072541 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:35.626487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4602): Launched 16:13:35.935777 run osmo-stp_10.42.42.5(pid=4603): Launched 16:13:36.052133 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:13:36.580460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4605): Launched 16:13:36.698973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:13:36.957190 run patchelf(pid=4606): Launched 16:13:37.127375 run osmo-stp_10.42.42.5(pid=4603): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4603)] 16:13:37.256352 run osmo-stp_10.42.42.5(pid=4603): stdout: | (launched: 2022-12-13_16:13:35.878655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:37.387500 run osmo-stp_10.42.42.5(pid=4603): stderr: | [0;m[38;5;43m20221213161336051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161336051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161336051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161336051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161336052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161336052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161336052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:37.518932 run osmo-stp_10.42.42.5(pid=4603): stdout: | (launched: 2022-12-13_16:13:35.878655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:37.644384 run osmo-stp_10.42.42.5(pid=4603): stderr: | [0;m[38;5;43m20221213161336051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161336051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161336051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161336051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161336052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161336052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161336052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:37.792438 run patchelf(pid=4606): Terminating (SIGINT) 16:13:37.964218 run patchelf(pid=4606): Terminated: ok {rc=0} 16:13:38.088339 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4603): Process ended prematurely: osmo-stp_10.42.42.5(pid=4603) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4603)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 16:13:38.097567 tst ping.py:22: Test FAILED (6.7 sec) 16:13:38.124512 run osmo-hlr_10.42.42.2(pid=4600): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4600)] 16:13:38.172008 run osmo-hlr_10.42.42.2(pid=4600): stdout: | (launched: 2022-12-13_16:13:34.895926) 16:13:38.221355 run osmo-hlr_10.42.42.2(pid=4600): stderr: | [0;m[1;31m20221213161335073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161335073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161335073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161335073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161335073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161335073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161335085 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161335094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161335094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161335094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:38.270856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4599): Terminating (SIGTERM) 16:13:38.310527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4602): Terminating (SIGTERM) 16:13:38.350034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4605): Terminating (SIGTERM) 16:13:38.389992 --- ParallelTerminationStrategy: PID 4599 died... 16:13:38.409340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4599): Terminated: ok {rc=0} 16:13:38.453251 --- ParallelTerminationStrategy: PID 4602 died... 16:13:38.471852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4602): Terminated: ok {rc=0} 16:13:38.515573 --- ParallelTerminationStrategy: PID 4605 died... 16:13:38.534354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4605): Terminated: ok {rc=0} 16:13:38.620847 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:13:39.708814 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:39.720724 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:13:39.793583 tst ping_idle_ping.py: using LAC 34760 16:13:39.915808 tst ping_idle_ping.py: using RAC 80 16:13:40.036386 tst ping_idle_ping.py: using CellId 34760 16:13:40.165774 tst ping_idle_ping.py: using BVCI 34761 16:13:40.285022 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:40.297193 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:40.308940 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:40.320683 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:40.332714 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:40.344733 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:40.356998 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:13:40.368920 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:13:40.488172 tst ping_idle_ping.py:24: start network... 16:13:40.693344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:41.170305 run create_hlr_db(pid=4607): Launched 16:13:41.298564 bus /gobi_6: Setting Powered False 16:13:42.359680 run create_hlr_db(pid=4607): Terminated: ok {rc=0} 16:13:42.787092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4609): Launched 16:13:43.095406 run osmo-hlr_10.42.42.2(pid=4610): Launched 16:13:43.212864 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:43.757750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4612): Launched 16:13:44.066244 run osmo-stp_10.42.42.5(pid=4613): Launched 16:13:44.182949 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:13:44.714197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4615): Launched 16:13:44.834244 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:13:45.095088 run patchelf(pid=4616): Launched 16:13:45.267583 run osmo-stp_10.42.42.5(pid=4613): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4613)] 16:13:45.398434 run osmo-stp_10.42.42.5(pid=4613): stdout: | (launched: 2022-12-13_16:13:44.008927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:45.531002 run osmo-stp_10.42.42.5(pid=4613): stderr: | [0;m[38;5;43m20221213161344179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161344179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161344179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161344180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161344180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161344180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161344180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:45.664499 run osmo-stp_10.42.42.5(pid=4613): stdout: | (launched: 2022-12-13_16:13:44.008927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:45.790816 run osmo-stp_10.42.42.5(pid=4613): stderr: | [0;m[38;5;43m20221213161344179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161344179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161344179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161344180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161344180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161344180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161344180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:45.963457 run patchelf(pid=4616): Terminating (SIGINT) 16:13:46.149091 run patchelf(pid=4616): Terminated: ok {rc=0} 16:13:46.275994 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4613): Process ended prematurely: osmo-stp_10.42.42.5(pid=4613) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4613)] [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:13:46.285802 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:13:46.313573 run osmo-hlr_10.42.42.2(pid=4610): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4610)] 16:13:46.362545 run osmo-hlr_10.42.42.2(pid=4610): stdout: | (launched: 2022-12-13_16:13:43.037815) 16:13:46.412850 run osmo-hlr_10.42.42.2(pid=4610): stderr: | [0;m[1;31m20221213161343213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161343213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161343213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161343213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161343213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161343213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161343226 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161343235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161343235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161343235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:46.463508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4609): Terminating (SIGTERM) 16:13:46.504785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4612): Terminating (SIGTERM) 16:13:46.547143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4615): Terminating (SIGTERM) 16:13:46.588586 --- ParallelTerminationStrategy: PID 4609 died... 16:13:46.607765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4609): Terminated: ok {rc=0} 16:13:46.652755 --- ParallelTerminationStrategy: PID 4612 died... 16:13:46.672370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4612): Terminated: ok {rc=0} 16:13:46.717454 --- ParallelTerminationStrategy: PID 4615 died... 16:13:46.736662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4615): Terminated: ok {rc=0} 16:13:46.822210 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:13:48.127902 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:13:48.135073 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:13:48.169214 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:13:48.204483 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:13:48.258369 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:13:48.292526 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:13:48.328062 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:13:48.890706 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:13:48.897257 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:13:48.909753 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:13:48.983898 tst switch_tch_pdch.py: using LAC 34761 16:13:49.114178 tst switch_tch_pdch.py: using RAC 81 16:13:49.243054 tst switch_tch_pdch.py: using CellId 34761 16:13:49.372424 tst switch_tch_pdch.py: using BVCI 34762 16:13:49.491133 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:13:49.503025 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:13:49.514813 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:13:49.526719 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:13:49.538858 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:13:49.550906 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:13:49.563124 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:13:49.575246 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:13:49.695708 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:13:49.816300 tst switch_tch_pdch.py:51: start network... 16:13:50.036673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:50.517485 run create_hlr_db(pid=4622): Launched 16:13:50.645868 bus /gobi_6: Setting Powered False 16:13:51.710962 run create_hlr_db(pid=4622): Terminated: ok {rc=0} 16:13:52.150948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4624): Launched 16:13:52.458975 run osmo-hlr_10.42.42.2(pid=4625): Launched 16:13:52.575936 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:53.103058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4627): Launched 16:13:53.411078 run osmo-stp_10.42.42.5(pid=4628): Launched 16:13:53.527451 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:13:54.057021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4630): Launched 16:13:54.174504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:13:54.433496 run patchelf(pid=4631): Launched 16:13:54.603613 run osmo-stp_10.42.42.5(pid=4628): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4628)] 16:13:54.732213 run osmo-stp_10.42.42.5(pid=4628): stdout: | (launched: 2022-12-13_16:13:53.353966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:54.863032 run osmo-stp_10.42.42.5(pid=4628): stderr: | [0;m[38;5;43m20221213161353523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161353523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161353523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161353524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161353524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161353524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161353525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:54.993733 run osmo-stp_10.42.42.5(pid=4628): stdout: | (launched: 2022-12-13_16:13:53.353966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:55.118036 run osmo-stp_10.42.42.5(pid=4628): stderr: | [0;m[38;5;43m20221213161353523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161353523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161353523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161353524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161353524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161353524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161353525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:55.265412 run patchelf(pid=4631): Terminating (SIGINT) 16:13:55.437456 run patchelf(pid=4631): Terminated: ok {rc=0} 16:13:55.560589 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4628): Process ended prematurely: osmo-stp_10.42.42.5(pid=4628) [trial-2391↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4628)] [trial-2391↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:13:55.569634 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 16:13:55.596605 run osmo-hlr_10.42.42.2(pid=4625): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4625)] 16:13:55.644803 run osmo-hlr_10.42.42.2(pid=4625): stdout: | (launched: 2022-12-13_16:13:52.401614) 16:13:55.695026 run osmo-hlr_10.42.42.2(pid=4625): stderr: | [0;m[1;31m20221213161352576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161352576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161352577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161352577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161352577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161352577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161352591 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161352602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161352603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161352603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:55.745758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4624): Terminating (SIGTERM) 16:13:55.785594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4627): Terminating (SIGTERM) 16:13:55.825400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4630): Terminating (SIGTERM) 16:13:55.865383 --- ParallelTerminationStrategy: PID 4624 died... 16:13:55.884581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4624): Terminated: ok {rc=0} 16:13:55.928238 --- ParallelTerminationStrategy: PID 4627 died... 16:13:55.946807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4627): Terminated: ok {rc=0} 16:13:55.990378 --- ParallelTerminationStrategy: PID 4630 died... 16:13:56.008807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4630): Terminated: ok {rc=0} 16:13:56.095156 bus /gobi_0: Setting Powered False 16:13:57.194262 bus /gobi_0: Setting Powered False 16:13:58.309176 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:13:59.564564 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:13:59.570472 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:13:59.604290 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:13:59.640012 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:13:59.693799 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:13:59.728427 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:13:59.763943 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:14:00.324345 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:14:00.330847 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:14:00.343141 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:14:00.420754 tst switch_tch_pdch.py: using LAC 34762 16:14:00.550335 tst switch_tch_pdch.py: using RAC 82 16:14:00.676534 tst switch_tch_pdch.py: using CellId 34762 16:14:00.802239 tst switch_tch_pdch.py: using BVCI 34763 16:14:00.950956 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:14:00.963250 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:14:00.975398 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:14:00.987613 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:14:01.000117 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:14:01.012701 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:14:01.026461 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:14:01.041594 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:14:01.186884 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:14:01.326113 tst switch_tch_pdch.py:51: start network... 16:14:01.574558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:02.042405 run create_hlr_db(pid=4636): Launched 16:14:02.205858 bus /gobi_6: Setting Powered False 16:14:03.266936 run create_hlr_db(pid=4636): Terminated: ok {rc=0} 16:14:03.688768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4638): Launched 16:14:04.018467 run osmo-hlr_10.42.42.2(pid=4639): Launched 16:14:04.143299 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:04.680361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4641): Launched 16:14:05.010299 run osmo-stp_10.42.42.5(pid=4642): Launched 16:14:05.136066 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:14:05.671522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4644): Launched 16:14:05.797965 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:14:06.075210 run patchelf(pid=4645): Launched 16:14:06.257040 run osmo-stp_10.42.42.5(pid=4642): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4642)] 16:14:06.401361 run osmo-stp_10.42.42.5(pid=4642): stdout: | (launched: 2022-12-13_16:14:04.949578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:06.544423 run osmo-stp_10.42.42.5(pid=4642): stderr: | [0;m[38;5;43m20221213161405141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161405141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161405142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161405142 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161405143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161405143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161405143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:06.684547 run osmo-stp_10.42.42.5(pid=4642): stdout: | (launched: 2022-12-13_16:14:04.949578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:06.818509 run osmo-stp_10.42.42.5(pid=4642): stderr: | [0;m[38;5;43m20221213161405141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161405141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161405142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161405142 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161405143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161405143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161405143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:06.976590 run patchelf(pid=4645): Terminating (SIGINT) 16:14:07.159492 run patchelf(pid=4645): Terminated: ok {rc=0} 16:14:07.291198 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4642): Process ended prematurely: osmo-stp_10.42.42.5(pid=4642) [trial-2391↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4642)] [trial-2391↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:14:07.300938 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 16:14:07.329226 run osmo-hlr_10.42.42.2(pid=4639): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4639)] 16:14:07.380022 run osmo-hlr_10.42.42.2(pid=4639): stdout: | (launched: 2022-12-13_16:14:03.957751) 16:14:07.432290 run osmo-hlr_10.42.42.2(pid=4639): stderr: | [0;m[1;31m20221213161404156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161404156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161404156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161404156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161404156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161404156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161404168 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161404177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161404177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161404177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:07.485348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4638): Terminating (SIGTERM) 16:14:07.527380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4641): Terminating (SIGTERM) 16:14:07.569888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4644): Terminating (SIGTERM) 16:14:07.612922 --- ParallelTerminationStrategy: PID 4638 died... 16:14:07.633399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4638): Terminated: ok {rc=0} 16:14:07.679998 --- ParallelTerminationStrategy: PID 4641 died... 16:14:07.699899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4641): Terminated: ok {rc=0} 16:14:07.747243 --- ParallelTerminationStrategy: PID 4644 died... 16:14:07.767162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4644): Terminated: ok {rc=0} 16:14:07.857197 bus /gobi_0: Setting Powered False 16:14:08.956166 bus /gobi_0: Setting Powered False 16:14:10.074858 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_sms:trx-umtrx --------------------------------------------------------------------- 16:14:11.336460 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:11.341162 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:14:11.374951 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 16:14:11.382631 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 16:14:11.437728 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:14:11.471631 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 16:14:11.478657 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 16:14:12.017093 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 16:14:12.022537 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 16:14:12.034153 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 16:14:12.084584 tst mo_mt_sms.py: using LAC 34763 16:14:12.213025 tst mo_mt_sms.py: using RAC 83 16:14:12.340766 tst mo_mt_sms.py: using CellId 34763 16:14:12.469362 tst mo_mt_sms.py: using BVCI 34764 16:14:12.588546 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:14:12.706209 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:14:12.827430 tst mo_mt_sms.py:9: start nitb and bts... 16:14:13.049094 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:14:13.715328 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4655): Launched 16:14:14.046375 run osmo-nitb_10.42.42.2(pid=4656): Launched 16:14:14.230405 run osmo-nitb_10.42.42.2(pid=4656): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4656)] 16:14:14.377398 run osmo-nitb_10.42.42.2(pid=4656): stdout: | (launched: 2022-12-13_16:14:13.985543) 16:14:14.525467 run osmo-nitb_10.42.42.2(pid=4656): stderr: | (launched: 2022-12-13_16:14:14.034541) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:14:14.673774 run osmo-nitb_10.42.42.2(pid=4656): stdout: | (launched: 2022-12-13_16:14:13.985543) 16:14:14.816745 run osmo-nitb_10.42.42.2(pid=4656): stderr: | (launched: 2022-12-13_16:14:14.034541) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4656): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4656) [trial-2391↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4656)] 16:14:15.172774 tst osmo-nitb_10.42.42.2(pid=4656): stdout: | (launched: 2022-12-13_16:14:13.985543) 16:14:15.305748 tst osmo-nitb_10.42.42.2(pid=4656): stderr: | (launched: 2022-12-13_16:14:14.034541) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:14:15.463171 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4656): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4656) [trial-2391↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4656)] [trial-2391↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 16:14:15.472288 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 16:14:15.479454 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4655): Terminating (SIGTERM) 16:14:15.691031 --- ParallelTerminationStrategy: PID 4655 died... 16:14:15.713241 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4655): Terminated: ok {rc=0} 16:14:15.803452 bus /sierra_3: Setting Powered False 16:14:16.921281 bus /sierra_3: Setting Powered False 16:14:18.051310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 sms:trx-umtrx --------------------------------------------------------------------- 16:14:19.250376 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:19.254906 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:14:19.287405 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:14:19.314295 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 16:14:19.367546 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:14:19.400455 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:14:19.427257 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 16:14:19.972044 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 16:14:19.977262 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:19.988069 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 16:14:20.036027 tst mo_mt_sms.py: using LAC 34764 16:14:20.156874 tst mo_mt_sms.py: using RAC 84 16:14:20.278424 tst mo_mt_sms.py: using CellId 34764 16:14:20.400478 tst mo_mt_sms.py: using BVCI 34765 16:14:20.513095 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:20.524006 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:20.534724 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:20.545438 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:20.556068 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:20.567103 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:14:20.682975 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:14:20.804439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:21.311915 run create_hlr_db(pid=4660): Launched 16:14:21.442073 bus /sierra_2: Setting Powered False 16:14:22.506834 run create_hlr_db(pid=4660): Terminated: ok {rc=0} 16:14:22.945986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4662): Launched 16:14:23.253983 run osmo-hlr_10.42.42.2(pid=4663): Launched 16:14:23.373193 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:23.917027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4665): Launched 16:14:24.225371 run osmo-stp_10.42.42.5(pid=4666): Launched 16:14:24.342626 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:24.896024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4668): Launched 16:14:25.202993 run osmo-msc_10.42.42.6(pid=4669): Launched 16:14:25.374696 run osmo-stp_10.42.42.5(pid=4666): ERR: Terminated: ERROR {rc=1} [trial-2391↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4666)] 16:14:25.503808 run osmo-stp_10.42.42.5(pid=4666): stdout: | (launched: 2022-12-13_16:14:24.167553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:25.633473 run osmo-stp_10.42.42.5(pid=4666): stderr: | [0;m[38;5;43m20221213161424338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161424338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161424338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161424338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161424339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161424339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161424339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:25.760512 run osmo-stp_10.42.42.5(pid=4666): stdout: | (launched: 2022-12-13_16:14:24.167553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:25.882019 run osmo-stp_10.42.42.5(pid=4666): stderr: | [0;m[38;5;43m20221213161424338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161424338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161424338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161424338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161424339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161424339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161424339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:26.027759 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4666): Process ended prematurely: osmo-stp_10.42.42.5(pid=4666) [trial-2391↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4666)] [trial-2391↪sms:trx-umtrx↪mo_mt_sms.py:16] 16:14:26.036219 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 16:14:26.062291 run osmo-hlr_10.42.42.2(pid=4663): ERR: Terminated: ERROR {rc=237} [trial-2391↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4663)] 16:14:26.111138 run osmo-hlr_10.42.42.2(pid=4663): stdout: | (launched: 2022-12-13_16:14:23.196443) 16:14:26.161336 run osmo-hlr_10.42.42.2(pid=4663): stderr: | [0;m[1;31m20221213161423373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161423373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161423373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161423373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161423373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161423373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161423386 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161423394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161423394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161423394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:26.230649 run osmo-msc_10.42.42.6(pid=4669): ERR: Terminated: ERROR {rc=2} [trial-2391↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4669)] 16:14:26.278541 run osmo-msc_10.42.42.6(pid=4669): stdout: | (launched: 2022-12-13_16:14:25.145737) 16:14:26.328091 run osmo-msc_10.42.42.6(pid=4669): stderr: | [0;m[38;5;43m20221213161425419 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161425419 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c02489c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161425419 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161425419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161425419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161425419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161425421 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161425422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161425422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161425422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:26.378019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4662): Terminating (SIGTERM) 16:14:26.417833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4665): Terminating (SIGTERM) 16:14:26.457596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4668): Terminating (SIGTERM) 16:14:26.497661 --- ParallelTerminationStrategy: PID 4662 died... 16:14:26.516802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4662): Terminated: ok {rc=0} 16:14:26.560472 --- ParallelTerminationStrategy: PID 4665 died... 16:14:26.579128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4665): Terminated: ok {rc=0} 16:14:26.622879 --- ParallelTerminationStrategy: PID 4668 died... 16:14:26.641617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4668): Terminated: ok {rc=0} 16:14:26.727580 bus /sierra_3: Setting Powered False 16:14:27.827242 bus /sierra_3: Setting Powered False 16:14:28.940614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 16:14:30.169600 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:30.173747 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:14:30.206338 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 16:14:30.213206 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 16:14:30.249158 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:14:30.282039 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 16:14:30.288763 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 16:14:30.808456 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2391 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 16:14:30.813518 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 16:14:30.824219 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 16:14:30.873566 tst assert_extension.py: using LAC 34765 16:14:31.006808 tst assert_extension.py: using RAC 85 16:14:31.129429 tst assert_extension.py: using CellId 34765 16:14:31.259010 tst assert_extension.py: using BVCI 34766 16:14:31.380553 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 16:14:31.531934 tst assert_extension.py:10: start nitb and bts... 16:14:31.743242 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:14:32.378986 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4674): Launched 16:14:32.689416 run osmo-nitb_10.42.42.2(pid=4675): Launched 16:14:32.859897 run osmo-nitb_10.42.42.2(pid=4675): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4675)] 16:14:32.997303 run osmo-nitb_10.42.42.2(pid=4675): stdout: | (launched: 2022-12-13_16:14:32.632061) 16:14:33.136657 run osmo-nitb_10.42.42.2(pid=4675): stderr: | (launched: 2022-12-13_16:14:32.677647) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:14:33.275745 run osmo-nitb_10.42.42.2(pid=4675): stdout: | (launched: 2022-12-13_16:14:32.632061) 16:14:33.409208 run osmo-nitb_10.42.42.2(pid=4675): stderr: | (launched: 2022-12-13_16:14:32.677647) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4675): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4675) [trial-2391↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4675)] 16:14:33.805662 tst osmo-nitb_10.42.42.2(pid=4675): stdout: | (launched: 2022-12-13_16:14:32.632061) 16:14:33.928839 tst osmo-nitb_10.42.42.2(pid=4675): stderr: | (launched: 2022-12-13_16:14:32.677647) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:14:34.075681 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4675): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4675) [trial-2391↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4675)] [trial-2391↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 16:14:34.084198 tst assert_extension.py:12: Test FAILED (3.3 sec) 16:14:34.090899 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4674): Terminating (SIGTERM) 16:14:34.300771 --- ParallelTerminationStrategy: PID 4674 died... 16:14:34.321631 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4674): Terminated: ok {rc=0} 16:14:34.409503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 ussd:trx-umtrx --------------------------------------------------------------------- 16:14:35.597496 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:35.602111 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:14:35.635854 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:14:35.665153 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 16:14:35.704207 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:14:35.739560 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:14:35.768100 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 16:14:36.293314 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2391 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 16:14:36.298872 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:36.310289 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 16:14:36.362365 tst assert_extension.py: using LAC 34766 16:14:36.481963 tst assert_extension.py: using RAC 86 16:14:36.600517 tst assert_extension.py: using CellId 34766 16:14:36.719342 tst assert_extension.py: using BVCI 34767 16:14:36.832111 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:36.843003 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:36.853846 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:36.864450 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:36.875537 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:14:36.886716 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 16:14:37.008721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:37.515262 run create_hlr_db(pid=4679): Launched 16:14:37.641630 bus /sierra_2: Setting Powered False 16:14:38.706153 run create_hlr_db(pid=4679): Terminated: ok {rc=0} 16:14:39.145715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4681): Launched 16:14:39.454560 run osmo-hlr_10.42.42.2(pid=4682): Launched 16:14:39.573746 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:40.108767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4684): Launched 16:14:40.416244 run osmo-stp_10.42.42.5(pid=4685): Launched 16:14:40.533704 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:41.088235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4687): Launched 16:14:41.396494 run osmo-msc_10.42.42.6(pid=4688): Launched 16:14:41.568447 run osmo-stp_10.42.42.5(pid=4685): ERR: Terminated: ERROR {rc=1} [trial-2391↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4685)] 16:14:41.696880 run osmo-stp_10.42.42.5(pid=4685): stdout: | (launched: 2022-12-13_16:14:40.358971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:41.825802 run osmo-stp_10.42.42.5(pid=4685): stderr: | [0;m[38;5;43m20221213161440528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161440528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161440528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161440529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161440529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161440530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161440530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:41.952541 run osmo-stp_10.42.42.5(pid=4685): stdout: | (launched: 2022-12-13_16:14:40.358971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:42.074628 run osmo-stp_10.42.42.5(pid=4685): stderr: | [0;m[38;5;43m20221213161440528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161440528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161440528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161440529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161440529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161440530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161440530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:42.219929 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4685): Process ended prematurely: osmo-stp_10.42.42.5(pid=4685) [trial-2391↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4685)] [trial-2391↪ussd:trx-umtrx↪assert_extension.py:17] 16:14:42.228386 tst assert_extension.py:17: Test FAILED (5.9 sec) 16:14:42.254604 run osmo-hlr_10.42.42.2(pid=4682): ERR: Terminated: ERROR {rc=237} [trial-2391↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4682)] 16:14:42.302999 run osmo-hlr_10.42.42.2(pid=4682): stdout: | (launched: 2022-12-13_16:14:39.397128) 16:14:42.352485 run osmo-hlr_10.42.42.2(pid=4682): stderr: | [0;m[1;31m20221213161439574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161439574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161439574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161439574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161439574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161439574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161439629 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161439638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161439638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161439638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:42.421747 run osmo-msc_10.42.42.6(pid=4688): ERR: Terminated: ERROR {rc=2} [trial-2391↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4688)] 16:14:42.469556 run osmo-msc_10.42.42.6(pid=4688): stdout: | (launched: 2022-12-13_16:14:41.338501) 16:14:42.519093 run osmo-msc_10.42.42.6(pid=4688): stderr: | [0;m[38;5;43m20221213161441611 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161441611 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f63ecdcac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161441611 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161441611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161441611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161441611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161441613 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161441614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161441614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161441614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:42.568942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4681): Terminating (SIGTERM) 16:14:42.608825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4684): Terminating (SIGTERM) 16:14:42.648811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4687): Terminating (SIGTERM) 16:14:42.689167 --- ParallelTerminationStrategy: PID 4681 died... 16:14:42.708393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4681): Terminated: ok {rc=0} 16:14:42.752414 --- ParallelTerminationStrategy: PID 4684 died... 16:14:42.771095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4684): Terminated: ok {rc=0} 16:14:42.814831 --- ParallelTerminationStrategy: PID 4687 died... 16:14:42.833516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4687): Terminated: ok {rc=0} 16:14:42.917400 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:14:44.128730 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:44.135790 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:14:44.168271 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:14:44.195277 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:14:44.248028 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:14:44.282297 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:14:44.310792 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:14:44.858910 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:14:44.909593 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:44.920893 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:14:44.990157 tst mo_mt_call.py: using LAC 34767 16:14:45.111793 tst mo_mt_call.py: using RAC 87 16:14:45.234863 tst mo_mt_call.py: using CellId 34767 16:14:45.358257 tst mo_mt_call.py: using BVCI 34768 16:14:45.472874 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:45.484133 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:45.495307 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:45.506353 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:45.517492 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:45.528500 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:14:45.653405 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:14:45.774418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:46.277315 run create_hlr_db(pid=4693): Launched 16:14:46.464511 bus /sierra_2: Setting Powered False 16:14:47.527133 run create_hlr_db(pid=4693): Terminated: ok {rc=0} 16:14:48.026406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4695): Launched 16:14:48.362626 run osmo-hlr_10.42.42.2(pid=4696): Launched 16:14:48.491833 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:49.068324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4698): Launched 16:14:49.403923 run osmo-stp_10.42.42.5(pid=4699): Launched 16:14:49.533533 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:50.138727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4701): Launched 16:14:50.474557 run osmo-msc_10.42.42.6(pid=4702): Launched 16:14:50.663098 run osmo-stp_10.42.42.5(pid=4699): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4699)] 16:14:50.803708 run osmo-stp_10.42.42.5(pid=4699): stdout: | (launched: 2022-12-13_16:14:49.342305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:50.944351 run osmo-stp_10.42.42.5(pid=4699): stderr: | [0;m[38;5;43m20221213161449534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161449535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161449535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161449535 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161449536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161449536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161449536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:51.083726 run osmo-stp_10.42.42.5(pid=4699): stdout: | (launched: 2022-12-13_16:14:49.342305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:51.216039 run osmo-stp_10.42.42.5(pid=4699): stderr: | [0;m[38;5;43m20221213161449534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161449535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161449535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161449535 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161449536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161449536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161449536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:51.374442 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4699): Process ended prematurely: osmo-stp_10.42.42.5(pid=4699) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4699)] [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:14:51.384295 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:14:51.412713 run osmo-hlr_10.42.42.2(pid=4696): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4696)] 16:14:51.463833 run osmo-hlr_10.42.42.2(pid=4696): stdout: | (launched: 2022-12-13_16:14:48.300934) 16:14:51.515980 run osmo-hlr_10.42.42.2(pid=4696): stderr: | [0;m[1;31m20221213161448501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161448501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161448501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161448501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161448502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161448502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161448514 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161448522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161448522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161448522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:51.589235 run osmo-msc_10.42.42.6(pid=4702): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4702)] 16:14:51.639499 run osmo-msc_10.42.42.6(pid=4702): stdout: | (launched: 2022-12-13_16:14:50.413096) 16:14:51.691479 run osmo-msc_10.42.42.6(pid=4702): stderr: | [0;m[38;5;43m20221213161450735 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161450735 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd3ae289c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161450735 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161450735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161450736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161450736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161450738 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161450738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161450738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161450738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:51.744681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4695): Terminating (SIGTERM) 16:14:51.787355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4698): Terminating (SIGTERM) 16:14:51.830752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4701): Terminating (SIGTERM) 16:14:51.873801 --- ParallelTerminationStrategy: PID 4695 died... 16:14:51.894841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4695): Terminated: ok {rc=0} 16:14:51.941753 --- ParallelTerminationStrategy: PID 4698 died... 16:14:51.961958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4698): Terminated: ok {rc=0} 16:14:52.009233 --- ParallelTerminationStrategy: PID 4701 died... 16:14:52.029607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4701): Terminated: ok {rc=0} 16:14:52.120004 bus /sierra_3: Setting Powered False 16:14:53.220841 bus /sierra_3: Setting Powered False 16:14:54.339272 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:14:55.492404 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:55.505167 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:14:55.583082 tst mo_mt_call_osmux.py: using LAC 34768 16:14:55.713658 tst mo_mt_call_osmux.py: using RAC 88 16:14:55.845477 tst mo_mt_call_osmux.py: using CellId 34768 16:14:55.978717 tst mo_mt_call_osmux.py: using BVCI 34769 16:14:56.101827 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:56.113550 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:56.125032 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:56.136621 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:56.148665 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:14:56.160557 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:14:56.284183 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:14:56.403833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:56.923365 run create_hlr_db(pid=4705): Launched 16:14:57.051524 bus /sierra_2: Setting Powered False 16:14:58.117799 run create_hlr_db(pid=4705): Terminated: ok {rc=0} 16:14:58.582648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4707): Launched 16:14:58.919790 run osmo-hlr_10.42.42.2(pid=4708): Launched 16:14:59.047667 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:59.627264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4710): Launched 16:14:59.962757 run osmo-stp_10.42.42.5(pid=4711): Launched 16:15:00.091020 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:00.695497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4713): Launched 16:15:01.052424 run osmo-msc_10.42.42.6(pid=4714): Launched 16:15:01.346416 run osmo-stp_10.42.42.5(pid=4711): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4711)] 16:15:01.634011 run osmo-stp_10.42.42.5(pid=4711): stdout: | (launched: 2022-12-13_16:14:59.900911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:01.906885 run osmo-stp_10.42.42.5(pid=4711): stderr: | [0;m[38;5;43m20221213161500093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161500093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161500093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161500094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161500094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161500094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161500094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:02.052772 run osmo-stp_10.42.42.5(pid=4711): stdout: | (launched: 2022-12-13_16:14:59.900911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:02.180851 run osmo-stp_10.42.42.5(pid=4711): stderr: | [0;m[38;5;43m20221213161500093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161500093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161500093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161500094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161500094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161500094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161500094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:02.357038 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4711): Process ended prematurely: osmo-stp_10.42.42.5(pid=4711) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4711)] [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:15:02.367071 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 16:15:02.395789 run osmo-hlr_10.42.42.2(pid=4708): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4708)] 16:15:02.447837 run osmo-hlr_10.42.42.2(pid=4708): stdout: | (launched: 2022-12-13_16:14:58.857808) 16:15:02.501453 run osmo-hlr_10.42.42.2(pid=4708): stderr: | [0;m[1;31m20221213161459057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161459057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161459057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161459057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161459057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161459057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161459069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161459078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161459078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161459078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:02.575470 run osmo-msc_10.42.42.6(pid=4714): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4714)] 16:15:02.626288 run osmo-msc_10.42.42.6(pid=4714): stdout: | (launched: 2022-12-13_16:15:00.991030) 16:15:02.680197 run osmo-msc_10.42.42.6(pid=4714): stderr: | [0;m[38;5;43m20221213161501598 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161501598 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa8bf4cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161501598 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161501598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161501598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161501599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161501600 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161501605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161501605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161501605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:02.733750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4707): Terminating (SIGTERM) 16:15:02.776843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4710): Terminating (SIGTERM) 16:15:02.820120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4713): Terminating (SIGTERM) 16:15:02.863735 --- ParallelTerminationStrategy: PID 4707 died... 16:15:02.884531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4707): Terminated: ok {rc=0} 16:15:02.931956 --- ParallelTerminationStrategy: PID 4710 died... 16:15:02.952277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4710): Terminated: ok {rc=0} 16:15:02.999226 --- ParallelTerminationStrategy: PID 4713 died... 16:15:03.019541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4713): Terminated: ok {rc=0} 16:15:03.109206 bus /sierra_3: Setting Powered False 16:15:04.208785 bus /sierra_3: Setting Powered False 16:15:05.327310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:15:06.582227 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:15:06.589682 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:15:06.624727 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:15:06.653305 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:15:06.707017 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:15:06.740881 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:15:06.769459 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:15:07.325818 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:15:07.382341 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:07.394341 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:15:07.464930 tst mo_mt_call.py: using LAC 34769 16:15:07.599224 tst mo_mt_call.py: using RAC 89 16:15:07.742827 tst mo_mt_call.py: using CellId 34769 16:15:07.878843 tst mo_mt_call.py: using BVCI 34770 16:15:08.002515 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:08.014565 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:08.026360 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:08.038164 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:08.050483 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:08.062803 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:15:08.183886 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:15:08.305987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:08.823167 run create_hlr_db(pid=4722): Launched 16:15:08.950638 bus /sierra_2: Setting Powered False 16:15:10.015731 run create_hlr_db(pid=4722): Terminated: ok {rc=0} 16:15:10.480074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4724): Launched 16:15:10.817360 run osmo-hlr_10.42.42.2(pid=4725): Launched 16:15:10.946550 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:11.524391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4727): Launched 16:15:11.860747 run osmo-stp_10.42.42.5(pid=4728): Launched 16:15:11.990919 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:12.595958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4730): Launched 16:15:12.933145 run osmo-msc_10.42.42.6(pid=4731): Launched 16:15:13.121620 run osmo-stp_10.42.42.5(pid=4728): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4728)] 16:15:13.262154 run osmo-stp_10.42.42.5(pid=4728): stdout: | (launched: 2022-12-13_16:15:11.799013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:13.403713 run osmo-stp_10.42.42.5(pid=4728): stderr: | [0;m[38;5;43m20221213161511990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161511991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161511991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161511991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161511992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161511992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161511992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:13.543333 run osmo-stp_10.42.42.5(pid=4728): stdout: | (launched: 2022-12-13_16:15:11.799013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:13.675941 run osmo-stp_10.42.42.5(pid=4728): stderr: | [0;m[38;5;43m20221213161511990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161511991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161511991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161511991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161511992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161511992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161511992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:13.835686 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4728): Process ended prematurely: osmo-stp_10.42.42.5(pid=4728) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4728)] [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:15:13.845554 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:15:13.874102 run osmo-hlr_10.42.42.2(pid=4725): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4725)] 16:15:13.925665 run osmo-hlr_10.42.42.2(pid=4725): stdout: | (launched: 2022-12-13_16:15:10.755331) 16:15:13.978819 run osmo-hlr_10.42.42.2(pid=4725): stderr: | [0;m[1;31m20221213161510954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161510954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161510954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161510954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161510954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161510954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161510966 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161510975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161510975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161510975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:14.052549 run osmo-msc_10.42.42.6(pid=4731): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4731)] 16:15:14.103603 run osmo-msc_10.42.42.6(pid=4731): stdout: | (launched: 2022-12-13_16:15:12.871544) 16:15:14.156735 run osmo-msc_10.42.42.6(pid=4731): stderr: | [0;m[38;5;43m20221213161513193 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161513193 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd04e245c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161513193 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161513193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161513194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161513194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161513195 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161513196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161513196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161513196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:14.210058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4724): Terminating (SIGTERM) 16:15:14.252549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4727): Terminating (SIGTERM) 16:15:14.295406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4730): Terminating (SIGTERM) 16:15:14.338723 --- ParallelTerminationStrategy: PID 4724 died... 16:15:14.359234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4724): Terminated: ok {rc=0} 16:15:14.406060 --- ParallelTerminationStrategy: PID 4727 died... 16:15:14.426405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4727): Terminated: ok {rc=0} 16:15:14.474278 --- ParallelTerminationStrategy: PID 4730 died... 16:15:14.494835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4730): Terminated: ok {rc=0} 16:15:14.583968 bus /sierra_3: Setting Powered False 16:15:15.683957 bus /sierra_3: Setting Powered False 16:15:16.804401 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:15:17.951965 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:17.964146 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:15:18.035194 tst mo_mt_call_osmux.py: using LAC 34770 16:15:18.158729 tst mo_mt_call_osmux.py: using RAC 90 16:15:18.283586 tst mo_mt_call_osmux.py: using CellId 34770 16:15:18.408745 tst mo_mt_call_osmux.py: using BVCI 34771 16:15:18.523475 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:18.534796 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:18.545929 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:18.556899 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:18.568280 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:15:18.579454 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:15:18.704109 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:15:18.829108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:19.313816 run create_hlr_db(pid=4733): Launched 16:15:19.442152 bus /sierra_2: Setting Powered False 16:15:20.503802 run create_hlr_db(pid=4733): Terminated: ok {rc=0} 16:15:20.938933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4735): Launched 16:15:21.255197 run osmo-hlr_10.42.42.2(pid=4736): Launched 16:15:21.375711 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:21.928020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4738): Launched 16:15:22.244058 run osmo-stp_10.42.42.5(pid=4739): Launched 16:15:22.362561 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:22.929080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4741): Launched 16:15:23.241977 run osmo-msc_10.42.42.6(pid=4742): Launched 16:15:23.416456 run osmo-stp_10.42.42.5(pid=4739): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4739)] 16:15:23.548401 run osmo-stp_10.42.42.5(pid=4739): stdout: | (launched: 2022-12-13_16:15:22.184659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:23.680251 run osmo-stp_10.42.42.5(pid=4739): stderr: | [0;m[38;5;43m20221213161522358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161522358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161522358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161522359 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161522359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161522359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161522359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:23.810483 run osmo-stp_10.42.42.5(pid=4739): stdout: | (launched: 2022-12-13_16:15:22.184659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:23.934504 run osmo-stp_10.42.42.5(pid=4739): stderr: | [0;m[38;5;43m20221213161522358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161522358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161522358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161522359 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161522359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161522359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161522359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:24.082749 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4739): Process ended prematurely: osmo-stp_10.42.42.5(pid=4739) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4739)] [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:15:24.091878 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:15:24.118492 run osmo-hlr_10.42.42.2(pid=4736): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4736)] 16:15:24.166233 run osmo-hlr_10.42.42.2(pid=4736): stdout: | (launched: 2022-12-13_16:15:21.197161) 16:15:24.215932 run osmo-hlr_10.42.42.2(pid=4736): stderr: | [0;m[1;31m20221213161521374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161521374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161521374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161521374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161521374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161521374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161521386 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161521395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161521395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161521395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:24.285184 run osmo-msc_10.42.42.6(pid=4742): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4742)] 16:15:24.332810 run osmo-msc_10.42.42.6(pid=4742): stdout: | (launched: 2022-12-13_16:15:23.183711) 16:15:24.382295 run osmo-msc_10.42.42.6(pid=4742): stderr: | [0;m[38;5;43m20221213161523458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161523458 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5945e4dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161523458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161523458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161523459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161523459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161523460 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161523461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161523461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161523461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:24.432091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4735): Terminating (SIGTERM) 16:15:24.471782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4738): Terminating (SIGTERM) 16:15:24.511553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4741): Terminating (SIGTERM) 16:15:24.551611 --- ParallelTerminationStrategy: PID 4735 died... 16:15:24.571029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4735): Terminated: ok {rc=0} 16:15:24.615035 --- ParallelTerminationStrategy: PID 4738 died... 16:15:24.633934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4738): Terminated: ok {rc=0} 16:15:24.677460 --- ParallelTerminationStrategy: PID 4741 died... 16:15:24.696147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4741): Terminated: ok {rc=0} 16:15:24.780272 bus /sierra_3: Setting Powered False 16:15:25.878911 bus /sierra_3: Setting Powered False 16:15:26.997177 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:15:28.250520 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:15:28.257758 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:15:28.291915 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:15:28.320171 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:15:28.377322 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:15:28.411855 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:15:28.440319 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:15:28.989837 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:15:29.044493 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:29.056371 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:15:29.128392 tst mo_mt_call.py: using LAC 34771 16:15:29.258961 tst mo_mt_call.py: using RAC 91 16:15:29.390925 tst mo_mt_call.py: using CellId 34771 16:15:29.524144 tst mo_mt_call.py: using BVCI 34772 16:15:29.647369 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:29.659039 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:29.670553 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:29.682222 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:29.694327 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:29.706345 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:15:29.827771 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:15:29.948809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:30.466887 run create_hlr_db(pid=4747): Launched 16:15:30.594838 bus /sierra_2: Setting Powered False 16:15:31.658412 run create_hlr_db(pid=4747): Terminated: ok {rc=0} 16:15:32.130139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4749): Launched 16:15:32.476812 run osmo-hlr_10.42.42.2(pid=4750): Launched 16:15:32.606852 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:33.183090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4752): Launched 16:15:33.520887 run osmo-stp_10.42.42.5(pid=4753): Launched 16:15:33.651490 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:34.256794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4755): Launched 16:15:34.593601 run osmo-msc_10.42.42.6(pid=4756): Launched 16:15:34.782379 run osmo-stp_10.42.42.5(pid=4753): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4753)] 16:15:34.922958 run osmo-stp_10.42.42.5(pid=4753): stdout: | (launched: 2022-12-13_16:15:33.459319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:35.063854 run osmo-stp_10.42.42.5(pid=4753): stderr: | [0;m[38;5;43m20221213161533652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161533653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161533653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161533653 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161533654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161533654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161533654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:35.203164 run osmo-stp_10.42.42.5(pid=4753): stdout: | (launched: 2022-12-13_16:15:33.459319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:35.335677 run osmo-stp_10.42.42.5(pid=4753): stderr: | [0;m[38;5;43m20221213161533652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161533653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161533653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161533653 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161533654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161533654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161533654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:35.494639 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4753): Process ended prematurely: osmo-stp_10.42.42.5(pid=4753) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4753)] [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:15:35.504576 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:15:35.532907 run osmo-hlr_10.42.42.2(pid=4750): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4750)] 16:15:35.584107 run osmo-hlr_10.42.42.2(pid=4750): stdout: | (launched: 2022-12-13_16:15:32.415047) 16:15:35.636455 run osmo-hlr_10.42.42.2(pid=4750): stderr: | [0;m[1;31m20221213161532613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161532613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161532614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161532614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161532614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161532614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161532626 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161532637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161532637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161532637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:35.709901 run osmo-msc_10.42.42.6(pid=4756): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4756)] 16:15:35.760445 run osmo-msc_10.42.42.6(pid=4756): stdout: | (launched: 2022-12-13_16:15:34.531514) 16:15:35.813194 run osmo-msc_10.42.42.6(pid=4756): stderr: | [0;m[38;5;43m20221213161534856 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161534856 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efc0b6d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161534856 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161534856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161534857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161534857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161534858 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161534859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161534859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161534859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:35.865814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4749): Terminating (SIGTERM) 16:15:35.908122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4752): Terminating (SIGTERM) 16:15:35.950719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4755): Terminating (SIGTERM) 16:15:35.994089 --- ParallelTerminationStrategy: PID 4749 died... 16:15:36.014882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4749): Terminated: ok {rc=0} 16:15:36.061749 --- ParallelTerminationStrategy: PID 4752 died... 16:15:36.081932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4752): Terminated: ok {rc=0} 16:15:36.129146 --- ParallelTerminationStrategy: PID 4755 died... 16:15:36.149413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4755): Terminated: ok {rc=0} 16:15:36.239135 bus /sierra_3: Setting Powered False 16:15:37.339125 bus /sierra_3: Setting Powered False 16:15:38.460471 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:15:39.609523 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:39.621698 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:15:39.692559 tst mo_mt_call_osmux.py: using LAC 34772 16:15:39.825297 tst mo_mt_call_osmux.py: using RAC 92 16:15:39.958048 tst mo_mt_call_osmux.py: using CellId 34772 16:15:40.088570 tst mo_mt_call_osmux.py: using BVCI 34773 16:15:40.210426 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:40.222315 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:40.234143 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:40.245732 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:40.258022 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:15:40.270074 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:15:40.393479 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:15:40.514288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:41.002888 run create_hlr_db(pid=4758): Launched 16:15:41.133934 bus /sierra_2: Setting Powered False 16:15:42.196340 run create_hlr_db(pid=4758): Terminated: ok {rc=0} 16:15:42.645157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4760): Launched 16:15:42.962630 run osmo-hlr_10.42.42.2(pid=4761): Launched 16:15:43.082732 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:43.637304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4763): Launched 16:15:43.951924 run osmo-stp_10.42.42.5(pid=4764): Launched 16:15:44.071468 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:44.639505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4766): Launched 16:15:44.955053 run osmo-msc_10.42.42.6(pid=4767): Launched 16:15:45.132673 run osmo-stp_10.42.42.5(pid=4764): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4764)] 16:15:45.264417 run osmo-stp_10.42.42.5(pid=4764): stdout: | (launched: 2022-12-13_16:15:43.893610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:45.396848 run osmo-stp_10.42.42.5(pid=4764): stderr: | [0;m[38;5;43m20221213161544067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161544067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161544067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161544067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161544068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161544068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161544068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:45.527594 run osmo-stp_10.42.42.5(pid=4764): stdout: | (launched: 2022-12-13_16:15:43.893610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:45.651936 run osmo-stp_10.42.42.5(pid=4764): stderr: | [0;m[38;5;43m20221213161544067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161544067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161544067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161544067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161544068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161544068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161544068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:45.801156 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4764): Process ended prematurely: osmo-stp_10.42.42.5(pid=4764) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4764)] [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:15:45.810365 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:15:45.851815 run osmo-hlr_10.42.42.2(pid=4761): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4761)] 16:15:45.917193 run osmo-hlr_10.42.42.2(pid=4761): stdout: | (launched: 2022-12-13_16:15:42.904133) 16:15:45.973663 run osmo-hlr_10.42.42.2(pid=4761): stderr: | [0;m[1;31m20221213161543081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161543081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161543081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161543081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161543081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161543081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161543093 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161543101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161543102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161543102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:46.053850 run osmo-msc_10.42.42.6(pid=4767): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4767)] 16:15:46.113099 run osmo-msc_10.42.42.6(pid=4767): stdout: | (launched: 2022-12-13_16:15:44.896318) 16:15:46.175441 run osmo-msc_10.42.42.6(pid=4767): stderr: | [0;m[38;5;43m20221213161545170 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161545170 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5e7311ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161545170 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161545170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161545170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161545171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161545172 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161545173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161545173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161545173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:46.236600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4760): Terminating (SIGTERM) 16:15:46.287580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4763): Terminating (SIGTERM) 16:15:46.339892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4766): Terminating (SIGTERM) 16:15:46.391152 --- ParallelTerminationStrategy: PID 4760 died... 16:15:46.415662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4760): Terminated: ok {rc=0} 16:15:46.471715 --- ParallelTerminationStrategy: PID 4763 died... 16:15:46.495883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4763): Terminated: ok {rc=0} 16:15:46.547181 --- ParallelTerminationStrategy: PID 4766 died... 16:15:46.569370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4766): Terminated: ok {rc=0} 16:15:46.664809 bus /sierra_3: Setting Powered False 16:15:47.768183 bus /sierra_3: Setting Powered False 16:15:48.887237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:15:50.139221 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:15:50.145976 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:15:50.178814 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:15:50.206695 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:15:50.259157 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:15:50.291821 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:15:50.319234 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:15:50.870040 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:15:50.925863 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:15:50.937782 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:15:51.010536 tst mo_mt_call.py: using LAC 34773 16:15:51.143015 tst mo_mt_call.py: using RAC 93 16:15:51.274913 tst mo_mt_call.py: using CellId 34773 16:15:51.407633 tst mo_mt_call.py: using BVCI 34774 16:15:51.528771 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:15:51.540651 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:15:51.552477 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:15:51.564246 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:15:51.576504 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:15:51.588558 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:15:51.707038 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:15:51.828544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:52.351418 run create_hlr_db(pid=4773): Launched 16:15:52.479643 bus /sierra_2: Setting Powered False 16:15:53.545817 run create_hlr_db(pid=4773): Terminated: ok {rc=0} 16:15:53.991119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4775): Launched 16:15:54.306718 run osmo-hlr_10.42.42.2(pid=4776): Launched 16:15:54.427760 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:54.967804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4778): Launched 16:15:55.283275 run osmo-stp_10.42.42.5(pid=4779): Launched 16:15:55.402280 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:55.966924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4781): Launched 16:15:56.281856 run osmo-msc_10.42.42.6(pid=4782): Launched 16:15:56.455976 run osmo-stp_10.42.42.5(pid=4779): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4779)] 16:15:56.587962 run osmo-stp_10.42.42.5(pid=4779): stdout: | (launched: 2022-12-13_16:15:55.225354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:56.720705 run osmo-stp_10.42.42.5(pid=4779): stderr: | [0;m[38;5;43m20221213161555398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161555398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161555399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161555399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161555400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161555400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161555400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:56.850181 run osmo-stp_10.42.42.5(pid=4779): stdout: | (launched: 2022-12-13_16:15:55.225354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:56.973237 run osmo-stp_10.42.42.5(pid=4779): stderr: | [0;m[38;5;43m20221213161555398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161555398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161555399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161555399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161555400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161555400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161555400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:57.120702 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4779): Process ended prematurely: osmo-stp_10.42.42.5(pid=4779) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4779)] [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:15:57.129896 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:15:57.156732 run osmo-hlr_10.42.42.2(pid=4776): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4776)] 16:15:57.204646 run osmo-hlr_10.42.42.2(pid=4776): stdout: | (launched: 2022-12-13_16:15:54.248635) 16:15:57.254277 run osmo-hlr_10.42.42.2(pid=4776): stderr: | [0;m[1;31m20221213161554426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161554427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161554427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161554427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161554427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161554427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161554440 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161554448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161554448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161554449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:57.323427 run osmo-msc_10.42.42.6(pid=4782): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4782)] 16:15:57.371064 run osmo-msc_10.42.42.6(pid=4782): stdout: | (launched: 2022-12-13_16:15:56.223562) 16:15:57.420520 run osmo-msc_10.42.42.6(pid=4782): stderr: | [0;m[38;5;43m20221213161556498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161556498 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b74cbec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161556498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161556498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161556498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161556499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161556500 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161556501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161556501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161556501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:57.470607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4775): Terminating (SIGTERM) 16:15:57.510506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4778): Terminating (SIGTERM) 16:15:57.550330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4781): Terminating (SIGTERM) 16:15:57.590409 --- ParallelTerminationStrategy: PID 4775 died... 16:15:57.609780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4775): Terminated: ok {rc=0} 16:15:57.653938 --- ParallelTerminationStrategy: PID 4778 died... 16:15:57.672606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4778): Terminated: ok {rc=0} 16:15:57.716408 --- ParallelTerminationStrategy: PID 4781 died... 16:15:57.734966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4781): Terminated: ok {rc=0} 16:15:57.819685 bus /sierra_3: Setting Powered False 16:15:58.919340 bus /sierra_3: Setting Powered False 16:16:00.040091 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:16:01.222425 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:16:01.240089 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:16:01.333787 tst mo_mt_call_osmux.py: using LAC 34774 16:16:01.472790 tst mo_mt_call_osmux.py: using RAC 94 16:16:01.609437 tst mo_mt_call_osmux.py: using CellId 34774 16:16:01.737162 tst mo_mt_call_osmux.py: using BVCI 34775 16:16:01.894323 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:16:01.907660 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:16:01.920673 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:16:01.935682 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:16:01.949895 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:16:01.963000 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:16:02.091629 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:16:02.213080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:02.703818 run create_hlr_db(pid=4784): Launched 16:16:02.833746 bus /sierra_2: Setting Powered False 16:16:03.895866 run create_hlr_db(pid=4784): Terminated: ok {rc=0} 16:16:04.353874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4786): Launched 16:16:04.691568 run osmo-hlr_10.42.42.2(pid=4787): Launched 16:16:04.821282 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:05.396354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4789): Launched 16:16:05.733310 run osmo-stp_10.42.42.5(pid=4790): Launched 16:16:05.863009 run osmo-msc_10.42.42.6: Starting osmo-msc 16:16:06.467739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4792): Launched 16:16:06.803822 run osmo-msc_10.42.42.6(pid=4793): Launched 16:16:06.992773 run osmo-stp_10.42.42.5(pid=4790): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4790)] 16:16:07.133617 run osmo-stp_10.42.42.5(pid=4790): stdout: | (launched: 2022-12-13_16:16:05.671411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:07.275783 run osmo-stp_10.42.42.5(pid=4790): stderr: | [0;m[38;5;43m20221213161605865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161605866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161605866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161605866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161605867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161605867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161605867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:07.415463 run osmo-stp_10.42.42.5(pid=4790): stdout: | (launched: 2022-12-13_16:16:05.671411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:07.548474 run osmo-stp_10.42.42.5(pid=4790): stderr: | [0;m[38;5;43m20221213161605865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161605866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161605866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161605866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161605867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161605867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161605867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:07.707837 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4790): Process ended prematurely: osmo-stp_10.42.42.5(pid=4790) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4790)] [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:16:07.717671 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 16:16:07.745878 run osmo-hlr_10.42.42.2(pid=4787): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4787)] 16:16:07.797725 run osmo-hlr_10.42.42.2(pid=4787): stdout: | (launched: 2022-12-13_16:16:04.630154) 16:16:07.851120 run osmo-hlr_10.42.42.2(pid=4787): stderr: | [0;m[1;31m20221213161604829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161604829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161604829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161604829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161604829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161604829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161604841 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161604850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161604850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161604850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:07.924861 run osmo-msc_10.42.42.6(pid=4793): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4793)] 16:16:07.975595 run osmo-msc_10.42.42.6(pid=4793): stdout: | (launched: 2022-12-13_16:16:06.741488) 16:16:08.028451 run osmo-msc_10.42.42.6(pid=4793): stderr: | [0;m[38;5;43m20221213161607064 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161607064 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f066b211c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161607064 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161607064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161607065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161607065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161607066 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161607067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161607067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161607067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:16:08.081594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4786): Terminating (SIGTERM) 16:16:08.123975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4789): Terminating (SIGTERM) 16:16:08.166708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4792): Terminating (SIGTERM) 16:16:08.209851 --- ParallelTerminationStrategy: PID 4786 died... 16:16:08.230485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4786): Terminated: ok {rc=0} 16:16:08.277432 --- ParallelTerminationStrategy: PID 4789 died... 16:16:08.297538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4789): Terminated: ok {rc=0} 16:16:08.344449 --- ParallelTerminationStrategy: PID 4792 died... 16:16:08.364582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4792): Terminated: ok {rc=0} 16:16:08.454831 bus /sierra_3: Setting Powered False 16:16:09.554596 bus /sierra_3: Setting Powered False 16:16:10.669955 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:16:11.924269 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:16:11.931897 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:16:11.966250 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:16:11.995205 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:16:12.048354 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:16:12.082187 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:16:12.110720 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:16:12.662767 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:16:12.717377 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:12.729238 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:16:12.800364 tst mo_mt_call.py: using LAC 34775 16:16:12.930357 tst mo_mt_call.py: using RAC 95 16:16:13.061891 tst mo_mt_call.py: using CellId 34775 16:16:13.192904 tst mo_mt_call.py: using BVCI 34776 16:16:13.314104 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:13.325864 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:13.337309 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:13.348667 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:13.360636 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:13.372509 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:16:13.491571 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:16:13.614445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:14.098941 run create_hlr_db(pid=4798): Launched 16:16:14.227416 bus /sierra_2: Setting Powered False 16:16:15.289451 run create_hlr_db(pid=4798): Terminated: ok {rc=0} 16:16:15.725305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4800): Launched 16:16:16.062397 run osmo-hlr_10.42.42.2(pid=4801): Launched 16:16:16.300791 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:16.967883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4803): Launched 16:16:17.300526 run osmo-stp_10.42.42.5(pid=4804): Launched 16:16:17.419380 run osmo-msc_10.42.42.6: Starting osmo-msc 16:16:17.982492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4806): Launched 16:16:18.297159 run osmo-msc_10.42.42.6(pid=4807): Launched 16:16:18.473310 run osmo-stp_10.42.42.5(pid=4804): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4804)] 16:16:18.604751 run osmo-stp_10.42.42.5(pid=4804): stdout: | (launched: 2022-12-13_16:16:17.242093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:18.736674 run osmo-stp_10.42.42.5(pid=4804): stderr: | [0;m[38;5;43m20221213161617412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161617412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161617412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161617413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161617413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161617413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161617413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:18.867190 run osmo-stp_10.42.42.5(pid=4804): stdout: | (launched: 2022-12-13_16:16:17.242093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:18.990413 run osmo-stp_10.42.42.5(pid=4804): stderr: | [0;m[38;5;43m20221213161617412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161617412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161617412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161617413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161617413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161617413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161617413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:19.137983 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4804): Process ended prematurely: osmo-stp_10.42.42.5(pid=4804) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4804)] [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:16:19.147178 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:16:19.173853 run osmo-hlr_10.42.42.2(pid=4801): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4801)] 16:16:19.222400 run osmo-hlr_10.42.42.2(pid=4801): stdout: | (launched: 2022-12-13_16:16:16.002944) 16:16:19.271770 run osmo-hlr_10.42.42.2(pid=4801): stderr: | [0;m[1;31m20221213161616192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161616192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161616192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161616192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161616192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161616192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161616214 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161616223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161616223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161616223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:19.340866 run osmo-msc_10.42.42.6(pid=4807): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4807)] 16:16:19.388658 run osmo-msc_10.42.42.6(pid=4807): stdout: | (launched: 2022-12-13_16:16:18.238738) 16:16:19.438178 run osmo-msc_10.42.42.6(pid=4807): stderr: | [0;m[38;5;43m20221213161618513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161618513 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f124c0c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161618513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161618513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161618513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161618513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161618515 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161618515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161618516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161618516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:16:19.487823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4800): Terminating (SIGTERM) 16:16:19.527579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4803): Terminating (SIGTERM) 16:16:19.567347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4806): Terminating (SIGTERM) 16:16:19.607290 --- ParallelTerminationStrategy: PID 4800 died... 16:16:19.626317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4800): Terminated: ok {rc=0} 16:16:19.670496 --- ParallelTerminationStrategy: PID 4803 died... 16:16:19.689206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4803): Terminated: ok {rc=0} 16:16:19.733219 --- ParallelTerminationStrategy: PID 4806 died... 16:16:19.751784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4806): Terminated: ok {rc=0} 16:16:19.839066 bus /sierra_3: Setting Powered False 16:16:20.939910 bus /sierra_3: Setting Powered False 16:16:22.053467 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:16:23.204764 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:23.217300 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:16:23.295239 tst mo_mt_call_osmux.py: using LAC 34776 16:16:23.424860 tst mo_mt_call_osmux.py: using RAC 96 16:16:23.553284 tst mo_mt_call_osmux.py: using CellId 34776 16:16:23.681641 tst mo_mt_call_osmux.py: using BVCI 34777 16:16:23.795827 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:23.807327 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:23.818670 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:23.829721 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:23.841139 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:16:23.852321 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:16:23.970750 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:16:24.094563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:24.581848 run create_hlr_db(pid=4809): Launched 16:16:24.709459 bus /sierra_2: Setting Powered False 16:16:25.771605 run create_hlr_db(pid=4809): Terminated: ok {rc=0} 16:16:26.207644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4811): Launched 16:16:26.523425 run osmo-hlr_10.42.42.2(pid=4812): Launched 16:16:26.643096 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:27.199199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4814): Launched 16:16:27.515533 run osmo-stp_10.42.42.5(pid=4815): Launched 16:16:27.635516 run osmo-msc_10.42.42.6: Starting osmo-msc 16:16:28.200601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4817): Launched 16:16:28.517892 run osmo-msc_10.42.42.6(pid=4818): Launched 16:16:28.694372 run osmo-stp_10.42.42.5(pid=4815): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4815)] 16:16:28.826969 run osmo-stp_10.42.42.5(pid=4815): stdout: | (launched: 2022-12-13_16:16:27.457078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:28.959714 run osmo-stp_10.42.42.5(pid=4815): stderr: | [0;m[38;5;43m20221213161627629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161627629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161627629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161627630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161627630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161627630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161627630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:29.090717 run osmo-stp_10.42.42.5(pid=4815): stdout: | (launched: 2022-12-13_16:16:27.457078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:29.214752 run osmo-stp_10.42.42.5(pid=4815): stderr: | [0;m[38;5;43m20221213161627629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161627629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161627629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161627630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161627630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161627630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161627630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:29.363401 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4815): Process ended prematurely: osmo-stp_10.42.42.5(pid=4815) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4815)] [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:16:29.372548 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:16:29.399458 run osmo-hlr_10.42.42.2(pid=4812): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4812)] 16:16:29.448041 run osmo-hlr_10.42.42.2(pid=4812): stdout: | (launched: 2022-12-13_16:16:26.464934) 16:16:29.498297 run osmo-hlr_10.42.42.2(pid=4812): stderr: | [0;m[1;31m20221213161626645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161626645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161626645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161626645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161626645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161626646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161626657 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161626666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161626667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161626667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:29.568482 run osmo-msc_10.42.42.6(pid=4818): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4818)] 16:16:29.616943 run osmo-msc_10.42.42.6(pid=4818): stdout: | (launched: 2022-12-13_16:16:28.459240) 16:16:29.666762 run osmo-msc_10.42.42.6(pid=4818): stderr: | [0;m[38;5;43m20221213161628734 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161628734 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3db438cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161628734 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161628734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161628734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161628735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161628736 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161628737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161628737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161628737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:16:29.717056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4811): Terminating (SIGTERM) 16:16:29.757212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4814): Terminating (SIGTERM) 16:16:29.797543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4817): Terminating (SIGTERM) 16:16:29.838370 --- ParallelTerminationStrategy: PID 4811 died... 16:16:29.858106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4811): Terminated: ok {rc=0} 16:16:29.902877 --- ParallelTerminationStrategy: PID 4814 died... 16:16:29.922010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4814): Terminated: ok {rc=0} 16:16:29.966638 --- ParallelTerminationStrategy: PID 4817 died... 16:16:29.985755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4817): Terminated: ok {rc=0} 16:16:30.072682 bus /sierra_3: Setting Powered False 16:16:31.170140 bus /sierra_3: Setting Powered False 16:16:32.291509 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:16:33.545317 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:16:33.551948 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:16:33.584545 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:16:33.611483 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:16:33.667604 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:16:33.701414 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:16:33.728374 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:16:34.279530 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:16:34.334305 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:34.346363 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:16:34.424143 tst mo_mt_call.py: using LAC 34777 16:16:34.553975 tst mo_mt_call.py: using RAC 97 16:16:34.685295 tst mo_mt_call.py: using CellId 34777 16:16:34.813585 tst mo_mt_call.py: using BVCI 34778 16:16:34.937381 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:34.949145 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:34.960714 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:34.972449 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:34.984464 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:34.996472 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:16:35.116494 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:16:35.239508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:35.757056 run create_hlr_db(pid=4823): Launched 16:16:35.885914 bus /sierra_2: Setting Powered False 16:16:36.951523 run create_hlr_db(pid=4823): Terminated: ok {rc=0} 16:16:37.397631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4825): Launched 16:16:37.711868 run osmo-hlr_10.42.42.2(pid=4826): Launched 16:16:37.831629 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:38.369154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4828): Launched 16:16:38.683947 run osmo-stp_10.42.42.5(pid=4829): Launched 16:16:38.803651 run osmo-msc_10.42.42.6: Starting osmo-msc 16:16:39.369992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4831): Launched 16:16:39.684868 run osmo-msc_10.42.42.6(pid=4832): Launched 16:16:39.861906 run osmo-stp_10.42.42.5(pid=4829): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4829)] 16:16:39.994186 run osmo-stp_10.42.42.5(pid=4829): stdout: | (launched: 2022-12-13_16:16:38.625741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:40.125233 run osmo-stp_10.42.42.5(pid=4829): stderr: | [0;m[38;5;43m20221213161638799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161638799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161638799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161638799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161638800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161638800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161638800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:40.254720 run osmo-stp_10.42.42.5(pid=4829): stdout: | (launched: 2022-12-13_16:16:38.625741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:40.378091 run osmo-stp_10.42.42.5(pid=4829): stderr: | [0;m[38;5;43m20221213161638799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161638799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161638799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161638799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161638800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161638800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161638800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:40.526213 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4829): Process ended prematurely: osmo-stp_10.42.42.5(pid=4829) [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4829)] [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:16:40.534996 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:16:40.561622 run osmo-hlr_10.42.42.2(pid=4826): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4826)] 16:16:40.609499 run osmo-hlr_10.42.42.2(pid=4826): stdout: | (launched: 2022-12-13_16:16:37.653439) 16:16:40.659188 run osmo-hlr_10.42.42.2(pid=4826): stderr: | [0;m[1;31m20221213161637832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161637832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161637832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161637832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161637832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161637832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161637867 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161637876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161637877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161637877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:40.728683 run osmo-msc_10.42.42.6(pid=4832): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4832)] 16:16:40.776655 run osmo-msc_10.42.42.6(pid=4832): stdout: | (launched: 2022-12-13_16:16:39.626742) 16:16:40.826029 run osmo-msc_10.42.42.6(pid=4832): stderr: | [0;m[38;5;43m20221213161639900 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161639900 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fecb5931c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161639900 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161639900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161639900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161639900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161639902 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161639903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161639903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161639903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:16:40.875690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4825): Terminating (SIGTERM) 16:16:40.915451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4828): Terminating (SIGTERM) 16:16:40.955400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4831): Terminating (SIGTERM) 16:16:40.995532 --- ParallelTerminationStrategy: PID 4825 died... 16:16:41.015177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4825): Terminated: ok {rc=0} 16:16:41.059403 --- ParallelTerminationStrategy: PID 4828 died... 16:16:41.078041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4828): Terminated: ok {rc=0} 16:16:41.121904 --- ParallelTerminationStrategy: PID 4831 died... 16:16:41.140560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4831): Terminated: ok {rc=0} 16:16:41.226706 bus /sierra_3: Setting Powered False 16:16:42.326572 bus /sierra_3: Setting Powered False 16:16:43.440912 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:16:44.589244 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:44.601407 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:16:44.675846 tst mo_mt_call_osmux.py: using LAC 34778 16:16:44.797682 tst mo_mt_call_osmux.py: using RAC 98 16:16:44.918298 tst mo_mt_call_osmux.py: using CellId 34778 16:16:45.044517 tst mo_mt_call_osmux.py: using BVCI 34779 16:16:45.159405 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:45.170836 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:45.182159 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:45.193409 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:45.204691 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:16:45.215983 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:16:45.334310 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:16:45.456554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:45.994509 run create_hlr_db(pid=4834): Launched 16:16:46.165218 bus /sierra_2: Setting Powered False 16:16:47.230735 run create_hlr_db(pid=4834): Terminated: ok {rc=0} 16:16:47.700606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4836): Launched 16:16:48.038189 run osmo-hlr_10.42.42.2(pid=4837): Launched 16:16:48.166024 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:48.742698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4839): Launched 16:16:49.078594 run osmo-stp_10.42.42.5(pid=4840): Launched 16:16:49.207876 run osmo-msc_10.42.42.6: Starting osmo-msc 16:16:49.810402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4842): Launched 16:16:50.147447 run osmo-msc_10.42.42.6(pid=4843): Launched 16:16:50.336767 run osmo-stp_10.42.42.5(pid=4840): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4840)] 16:16:50.477286 run osmo-stp_10.42.42.5(pid=4840): stdout: | (launched: 2022-12-13_16:16:49.016235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:50.619053 run osmo-stp_10.42.42.5(pid=4840): stderr: | [0;m[38;5;43m20221213161649209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161649209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161649209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161649209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161649210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161649210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161649210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:50.758103 run osmo-stp_10.42.42.5(pid=4840): stdout: | (launched: 2022-12-13_16:16:49.016235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:50.891114 run osmo-stp_10.42.42.5(pid=4840): stderr: | [0;m[38;5;43m20221213161649209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161649209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161649209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161649209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161649210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161649210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161649210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:51.050009 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4840): Process ended prematurely: osmo-stp_10.42.42.5(pid=4840) [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4840)] [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:16:51.059751 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:16:51.087690 run osmo-hlr_10.42.42.2(pid=4837): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4837)] 16:16:51.138411 run osmo-hlr_10.42.42.2(pid=4837): stdout: | (launched: 2022-12-13_16:16:47.976189) 16:16:51.191463 run osmo-hlr_10.42.42.2(pid=4837): stderr: | [0;m[1;31m20221213161648175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161648175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161648175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161648175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161648175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161648175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161648187 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161648196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161648196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161648196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:51.264400 run osmo-msc_10.42.42.6(pid=4843): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4843)] 16:16:51.314497 run osmo-msc_10.42.42.6(pid=4843): stdout: | (launched: 2022-12-13_16:16:50.085410) 16:16:51.366235 run osmo-msc_10.42.42.6(pid=4843): stderr: | [0;m[38;5;43m20221213161650408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161650409 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a7812cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161650409 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161650409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161650409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161650409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161650411 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161650411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161650411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161650411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:16:51.418246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4836): Terminating (SIGTERM) 16:16:51.460729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4839): Terminating (SIGTERM) 16:16:51.503202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4842): Terminating (SIGTERM) 16:16:51.546010 --- ParallelTerminationStrategy: PID 4836 died... 16:16:51.566171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4836): Terminated: ok {rc=0} 16:16:51.612758 --- ParallelTerminationStrategy: PID 4839 died... 16:16:51.632886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4839): Terminated: ok {rc=0} 16:16:51.679462 --- ParallelTerminationStrategy: PID 4842 died... 16:16:51.699491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4842): Terminated: ok {rc=0} 16:16:51.788023 bus /sierra_3: Setting Powered False 16:16:52.886856 bus /sierra_3: Setting Powered False 16:16:54.006307 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:16:55.256474 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:16:55.262646 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:16:55.295003 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:16:55.321801 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:16:55.375259 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:16:55.408387 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:16:55.435376 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:16:55.982798 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:16:56.032697 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:16:56.043856 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:16:56.113584 tst mo_mt_call.py: using LAC 34779 16:16:56.238047 tst mo_mt_call.py: using RAC 99 16:16:56.361010 tst mo_mt_call.py: using CellId 34779 16:16:56.484459 tst mo_mt_call.py: using BVCI 34780 16:16:56.599013 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:16:56.610030 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:16:56.620756 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:16:56.631533 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:16:56.642412 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:16:56.653749 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:16:56.776045 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:16:56.895456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:57.380631 run create_hlr_db(pid=4848): Launched 16:16:57.509112 bus /sierra_2: Setting Powered False 16:16:58.571876 run create_hlr_db(pid=4848): Terminated: ok {rc=0} 16:16:59.028181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4850): Launched 16:16:59.363861 run osmo-hlr_10.42.42.2(pid=4851): Launched 16:16:59.494250 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:00.071269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4853): Launched 16:17:00.405799 run osmo-stp_10.42.42.5(pid=4854): Launched 16:17:00.534892 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:01.149964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4856): Launched 16:17:01.494631 run osmo-msc_10.42.42.6(pid=4860): Launched 16:17:01.804054 run osmo-stp_10.42.42.5(pid=4854): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4854)] 16:17:02.064459 run osmo-stp_10.42.42.5(pid=4854): stdout: | (launched: 2022-12-13_16:17:00.343728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:02.425841 run osmo-stp_10.42.42.5(pid=4854): stderr: | [0;m[38;5;43m20221213161700538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161700538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161700539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161700539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161700540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161700540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161700540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:02.572564 run osmo-stp_10.42.42.5(pid=4854): stdout: | (launched: 2022-12-13_16:17:00.343728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:02.704807 run osmo-stp_10.42.42.5(pid=4854): stderr: | [0;m[38;5;43m20221213161700538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161700538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161700539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161700539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161700540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161700540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161700540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:02.863499 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4854): Process ended prematurely: osmo-stp_10.42.42.5(pid=4854) [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4854)] [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:17:02.873457 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 16:17:02.901722 run osmo-hlr_10.42.42.2(pid=4851): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4851)] 16:17:02.952926 run osmo-hlr_10.42.42.2(pid=4851): stdout: | (launched: 2022-12-13_16:16:59.302312) 16:17:03.006156 run osmo-hlr_10.42.42.2(pid=4851): stderr: | [0;m[1;31m20221213161659500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161659500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161659500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161659500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161659500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161659500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161659513 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161659522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161659522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161659522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:03.079737 run osmo-msc_10.42.42.6(pid=4860): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4860)] 16:17:03.130510 run osmo-msc_10.42.42.6(pid=4860): stdout: | (launched: 2022-12-13_16:17:01.418758) 16:17:03.183081 run osmo-msc_10.42.42.6(pid=4860): stderr: | [0;m[38;5;43m20221213161701980 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161701980 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0a49f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161701980 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161701980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161701983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161701983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161701991 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161701993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161701993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161701993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:03.236535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4850): Terminating (SIGTERM) 16:17:03.279289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4853): Terminating (SIGTERM) 16:17:03.322260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4856): Terminating (SIGTERM) 16:17:03.365391 --- ParallelTerminationStrategy: PID 4850 died... 16:17:03.385951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4850): Terminated: ok {rc=0} 16:17:03.433134 --- ParallelTerminationStrategy: PID 4853 died... 16:17:03.453321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4853): Terminated: ok {rc=0} 16:17:03.500124 --- ParallelTerminationStrategy: PID 4856 died... 16:17:03.520282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4856): Terminated: ok {rc=0} 16:17:03.609496 bus /sierra_3: Setting Powered False 16:17:04.709039 bus /sierra_3: Setting Powered False 16:17:05.825513 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:17:06.978192 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:17:06.990613 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:17:07.064286 tst mo_mt_call_osmux.py: using LAC 34780 16:17:07.196932 tst mo_mt_call_osmux.py: using RAC 100 16:17:07.329134 tst mo_mt_call_osmux.py: using CellId 34780 16:17:07.461137 tst mo_mt_call_osmux.py: using BVCI 34781 16:17:07.583953 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:17:07.595499 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:17:07.606994 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:17:07.618524 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:17:07.630289 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:17:07.642063 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:17:07.764670 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:17:07.885744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:08.373277 run create_hlr_db(pid=4862): Launched 16:17:08.503550 bus /sierra_2: Setting Powered False 16:17:09.565725 run create_hlr_db(pid=4862): Terminated: ok {rc=0} 16:17:10.025315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4864): Launched 16:17:10.363230 run osmo-hlr_10.42.42.2(pid=4865): Launched 16:17:10.493781 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:11.076677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4867): Launched 16:17:11.414710 run osmo-stp_10.42.42.5(pid=4868): Launched 16:17:11.543655 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:12.155074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4870): Launched 16:17:12.493270 run osmo-msc_10.42.42.6(pid=4871): Launched 16:17:12.681343 run osmo-stp_10.42.42.5(pid=4868): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4868)] 16:17:12.822430 run osmo-stp_10.42.42.5(pid=4868): stdout: | (launched: 2022-12-13_16:17:11.352723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:12.964432 run osmo-stp_10.42.42.5(pid=4868): stderr: | [0;m[38;5;43m20221213161711546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161711546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161711547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161711547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161711547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161711547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161711547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:13.104077 run osmo-stp_10.42.42.5(pid=4868): stdout: | (launched: 2022-12-13_16:17:11.352723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:13.237080 run osmo-stp_10.42.42.5(pid=4868): stderr: | [0;m[38;5;43m20221213161711546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161711546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161711547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161711547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161711547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161711547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161711547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:13.396623 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4868): Process ended prematurely: osmo-stp_10.42.42.5(pid=4868) [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4868)] [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:17:13.406526 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:17:13.434892 run osmo-hlr_10.42.42.2(pid=4865): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4865)] 16:17:13.486602 run osmo-hlr_10.42.42.2(pid=4865): stdout: | (launched: 2022-12-13_16:17:10.301240) 16:17:13.539147 run osmo-hlr_10.42.42.2(pid=4865): stderr: | [0;m[1;31m20221213161710502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161710502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161710502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161710502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161710502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161710503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161710515 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161710525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161710525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161710525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:13.612345 run osmo-msc_10.42.42.6(pid=4871): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4871)] 16:17:13.662723 run osmo-msc_10.42.42.6(pid=4871): stdout: | (launched: 2022-12-13_16:17:12.431128) 16:17:13.715365 run osmo-msc_10.42.42.6(pid=4871): stderr: | [0;m[38;5;43m20221213161712755 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161712755 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6744abec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161712755 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161712755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161712755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161712755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161712757 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161712758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161712758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161712758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:13.768181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4864): Terminating (SIGTERM) 16:17:13.810221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4867): Terminating (SIGTERM) 16:17:13.853329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4870): Terminating (SIGTERM) 16:17:13.896146 --- ParallelTerminationStrategy: PID 4864 died... 16:17:13.917151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4864): Terminated: ok {rc=0} 16:17:13.963929 --- ParallelTerminationStrategy: PID 4867 died... 16:17:13.984067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4867): Terminated: ok {rc=0} 16:17:14.030675 --- ParallelTerminationStrategy: PID 4870 died... 16:17:14.050877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4870): Terminated: ok {rc=0} 16:17:14.140533 bus /sierra_3: Setting Powered False 16:17:15.238741 bus /sierra_3: Setting Powered False 16:17:16.354769 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:17:17.610247 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:17:17.616846 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:17:17.649583 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 16:17:17.676688 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 16:17:17.728811 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:17:17.761536 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 16:17:17.788715 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 16:17:18.341623 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 16:17:18.392080 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:18.403682 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:17:18.456314 tst mo_mt_call.py: using LAC 34781 16:17:18.578933 tst mo_mt_call.py: using RAC 101 16:17:18.703825 tst mo_mt_call.py: using CellId 34781 16:17:18.828450 tst mo_mt_call.py: using BVCI 34782 16:17:18.943454 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:18.954793 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:18.966152 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:18.977443 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:18.988933 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:19.000386 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:17:19.120053 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:17:19.242023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:19.760793 run create_hlr_db(pid=4876): Launched 16:17:19.891327 bus /sierra_2: Setting Powered False 16:17:20.957116 run create_hlr_db(pid=4876): Terminated: ok {rc=0} 16:17:21.405348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4878): Launched 16:17:21.721085 run osmo-hlr_10.42.42.2(pid=4879): Launched 16:17:21.840472 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:22.378874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4881): Launched 16:17:22.693291 run osmo-stp_10.42.42.5(pid=4882): Launched 16:17:22.812926 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:23.383933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4884): Launched 16:17:23.698090 run osmo-msc_10.42.42.6(pid=4885): Launched 16:17:23.873475 run osmo-stp_10.42.42.5(pid=4882): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4882)] 16:17:24.004867 run osmo-stp_10.42.42.5(pid=4882): stdout: | (launched: 2022-12-13_16:17:22.635141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:24.136444 run osmo-stp_10.42.42.5(pid=4882): stderr: | [0;m[38;5;43m20221213161722807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161722807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161722807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161722807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161722808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161722808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161722808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:24.266418 run osmo-stp_10.42.42.5(pid=4882): stdout: | (launched: 2022-12-13_16:17:22.635141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:24.390402 run osmo-stp_10.42.42.5(pid=4882): stderr: | [0;m[38;5;43m20221213161722807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161722807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161722807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161722807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161722808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161722808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161722808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:24.539441 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4882): Process ended prematurely: osmo-stp_10.42.42.5(pid=4882) [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4882)] [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 16:17:24.548570 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:17:24.575603 run osmo-hlr_10.42.42.2(pid=4879): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4879)] 16:17:24.623690 run osmo-hlr_10.42.42.2(pid=4879): stdout: | (launched: 2022-12-13_16:17:21.662836) 16:17:24.673348 run osmo-hlr_10.42.42.2(pid=4879): stderr: | [0;m[1;31m20221213161721840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161721840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161721840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161721840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161721840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161721840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161721853 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161721862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161721862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161721862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:24.742993 run osmo-msc_10.42.42.6(pid=4885): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4885)] 16:17:24.790930 run osmo-msc_10.42.42.6(pid=4885): stdout: | (launched: 2022-12-13_16:17:23.639553) 16:17:24.840612 run osmo-msc_10.42.42.6(pid=4885): stderr: | [0;m[38;5;43m20221213161723913 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161723914 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f33e94cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161723914 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161723914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161723914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161723914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161723916 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161723916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161723916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161723916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:24.890586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4878): Terminating (SIGTERM) 16:17:24.930491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4881): Terminating (SIGTERM) 16:17:24.970543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4884): Terminating (SIGTERM) 16:17:25.010929 --- ParallelTerminationStrategy: PID 4878 died... 16:17:25.030481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4878): Terminated: ok {rc=0} 16:17:25.074913 --- ParallelTerminationStrategy: PID 4881 died... 16:17:25.093843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4881): Terminated: ok {rc=0} 16:17:25.138097 --- ParallelTerminationStrategy: PID 4884 died... 16:17:25.156988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4884): Terminated: ok {rc=0} 16:17:25.240940 bus /sierra_3: Setting Powered False 16:17:26.340231 bus /sierra_3: Setting Powered False 16:17:27.457764 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 16:17:28.609122 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:28.621910 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:17:28.677552 tst mo_mt_call_osmux.py: using LAC 34782 16:17:28.801926 tst mo_mt_call_osmux.py: using RAC 102 16:17:28.926507 tst mo_mt_call_osmux.py: using CellId 34782 16:17:29.051428 tst mo_mt_call_osmux.py: using BVCI 34783 16:17:29.175332 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:29.187406 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:29.199187 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:29.211294 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:29.223496 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:17:29.235667 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:17:29.359130 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:17:29.478051 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:29.965163 run create_hlr_db(pid=4887): Launched 16:17:30.095498 bus /sierra_2: Setting Powered False 16:17:31.157352 run create_hlr_db(pid=4887): Terminated: ok {rc=0} 16:17:31.607701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4889): Launched 16:17:31.942321 run osmo-hlr_10.42.42.2(pid=4890): Launched 16:17:32.175826 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:32.732219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4892): Launched 16:17:33.050267 run osmo-stp_10.42.42.5(pid=4893): Launched 16:17:33.173336 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:33.744357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4895): Launched 16:17:34.063404 run osmo-msc_10.42.42.6(pid=4896): Launched 16:17:34.240366 run osmo-stp_10.42.42.5(pid=4893): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4893)] 16:17:34.373513 run osmo-stp_10.42.42.5(pid=4893): stdout: | (launched: 2022-12-13_16:17:32.991259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:34.505682 run osmo-stp_10.42.42.5(pid=4893): stderr: | [0;m[38;5;43m20221213161733162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161733162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161733163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161733163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161733163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161733164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161733164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:34.636668 run osmo-stp_10.42.42.5(pid=4893): stdout: | (launched: 2022-12-13_16:17:32.991259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:34.761195 run osmo-stp_10.42.42.5(pid=4893): stderr: | [0;m[38;5;43m20221213161733162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161733162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161733163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161733163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161733163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161733164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161733164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:34.910533 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4893): Process ended prematurely: osmo-stp_10.42.42.5(pid=4893) [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4893)] [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 16:17:34.919576 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:17:34.946359 run osmo-hlr_10.42.42.2(pid=4890): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4890)] 16:17:34.994386 run osmo-hlr_10.42.42.2(pid=4890): stdout: | (launched: 2022-12-13_16:17:31.882952) 16:17:35.044348 run osmo-hlr_10.42.42.2(pid=4890): stderr: | [0;m[1;31m20221213161732192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161732192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161732192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161732192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161732192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161732192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161732204 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161732213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161732213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161732213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:35.114090 run osmo-msc_10.42.42.6(pid=4896): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4896)] 16:17:35.162013 run osmo-msc_10.42.42.6(pid=4896): stdout: | (launched: 2022-12-13_16:17:34.004127) 16:17:35.211607 run osmo-msc_10.42.42.6(pid=4896): stderr: | [0;m[38;5;43m20221213161734278 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161734279 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7cd9c2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161734279 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161734279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161734279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161734279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161734281 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161734281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161734281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161734282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:35.261496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4889): Terminating (SIGTERM) 16:17:35.301589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4892): Terminating (SIGTERM) 16:17:35.341888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4895): Terminating (SIGTERM) 16:17:35.382165 --- ParallelTerminationStrategy: PID 4889 died... 16:17:35.401419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4889): Terminated: ok {rc=0} 16:17:35.446018 --- ParallelTerminationStrategy: PID 4892 died... 16:17:35.464784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4892): Terminated: ok {rc=0} 16:17:35.509189 --- ParallelTerminationStrategy: PID 4895 died... 16:17:35.527819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4895): Terminated: ok {rc=0} 16:17:35.615100 bus /sierra_3: Setting Powered False 16:17:36.715411 bus /sierra_3: Setting Powered False 16:17:37.833297 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 emergency:trx-umtrx --------------------------------------------------------------------- 16:17:39.090282 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:17:39.095330 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:17:39.128586 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:17:39.155829 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 16:17:39.241584 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:17:39.274233 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:17:39.301035 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 16:17:39.885311 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2391 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 16:17:39.890369 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:39.901129 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 16:17:39.949910 tst emergency_mo_mt_call.py: using LAC 34783 16:17:40.070898 tst emergency_mo_mt_call.py: using RAC 103 16:17:40.193363 tst emergency_mo_mt_call.py: using CellId 34783 16:17:40.315749 tst emergency_mo_mt_call.py: using BVCI 34784 16:17:40.437283 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:40.448810 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:40.460087 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:40.471449 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:40.483138 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:40.494793 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:17:40.615608 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:17:40.736172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:41.215394 run create_hlr_db(pid=4901): Launched 16:17:41.343235 bus /sierra_2: Setting Powered False 16:17:42.404691 run create_hlr_db(pid=4901): Terminated: ok {rc=0} 16:17:42.835863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4903): Launched 16:17:43.158250 run osmo-hlr_10.42.42.2(pid=4904): Launched 16:17:43.278026 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:43.808476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4906): Launched 16:17:44.118730 run osmo-stp_10.42.42.5(pid=4907): Launched 16:17:44.249266 tst emergency_mo_mt_call.py: using MSISDN 8218 16:17:44.414043 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:44.969297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4909): Launched 16:17:45.280290 run osmo-msc_10.42.42.6(pid=4910): Launched 16:17:45.454044 run osmo-stp_10.42.42.5(pid=4907): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4907)] 16:17:45.584583 run osmo-stp_10.42.42.5(pid=4907): stdout: | (launched: 2022-12-13_16:17:44.060680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:45.713949 run osmo-stp_10.42.42.5(pid=4907): stderr: | [0;m[38;5;43m20221213161744230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161744231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161744231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161744231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161744232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161744232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161744232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:45.850472 run osmo-stp_10.42.42.5(pid=4907): stdout: | (launched: 2022-12-13_16:17:44.060680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:45.975307 run osmo-stp_10.42.42.5(pid=4907): stderr: | [0;m[38;5;43m20221213161744230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161744231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161744231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161744231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161744232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161744232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161744232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:46.124386 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4907): Process ended prematurely: osmo-stp_10.42.42.5(pid=4907) [trial-2391↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4907)] [trial-2391↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 16:17:46.133550 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 16:17:46.160836 run osmo-hlr_10.42.42.2(pid=4904): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4904)] 16:17:46.210012 run osmo-hlr_10.42.42.2(pid=4904): stdout: | (launched: 2022-12-13_16:17:43.099974) 16:17:46.261176 run osmo-hlr_10.42.42.2(pid=4904): stderr: | [0;m[1;31m20221213161743275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161743275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161743275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161743275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161743275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161743275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161743287 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161743296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161743296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161743296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:46.332700 run osmo-msc_10.42.42.6(pid=4910): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4910)] 16:17:46.381975 run osmo-msc_10.42.42.6(pid=4910): stdout: | (launched: 2022-12-13_16:17:45.222218) 16:17:46.433061 run osmo-msc_10.42.42.6(pid=4910): stderr: | [0;m[38;5;43m20221213161745495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161745495 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe5fea08c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161745495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161745495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161745495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161745495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161745497 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161745498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161745498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161745498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:46.484611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4903): Terminating (SIGTERM) 16:17:46.525727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4906): Terminating (SIGTERM) 16:17:46.566654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4909): Terminating (SIGTERM) 16:17:46.608571 --- ParallelTerminationStrategy: PID 4903 died... 16:17:46.628385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4903): Terminated: ok {rc=0} 16:17:46.675119 --- ParallelTerminationStrategy: PID 4906 died... 16:17:46.694570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4906): Terminated: ok {rc=0} 16:17:46.739565 --- ParallelTerminationStrategy: PID 4909 died... 16:17:46.758997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4909): Terminated: ok {rc=0} 16:17:46.847758 bus /sierra_3: Setting Powered False 16:17:47.951869 bus /sierra_3: Setting Powered False 16:17:49.070045 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 16:17:50.159405 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:50.171730 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 16:17:50.225070 tst emergency_preemptive_call.py: using LAC 34784 16:17:50.354968 tst emergency_preemptive_call.py: using RAC 104 16:17:50.484472 tst emergency_preemptive_call.py: using CellId 34784 16:17:50.613091 tst emergency_preemptive_call.py: using BVCI 34785 16:17:50.733685 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:50.745118 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:50.756318 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:50.767536 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:50.779103 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:17:50.790632 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:17:50.909346 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:17:51.030316 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:17:51.148749 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:17:51.267311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:51.749228 run create_hlr_db(pid=4912): Launched 16:17:51.876457 bus /sierra_2: Setting Powered False 16:17:52.937171 run create_hlr_db(pid=4912): Terminated: ok {rc=0} 16:17:53.370231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4914): Launched 16:17:53.683847 run osmo-hlr_10.42.42.2(pid=4915): Launched 16:17:53.801962 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:54.333082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4917): Launched 16:17:54.643143 run osmo-stp_10.42.42.5(pid=4918): Launched 16:17:54.771003 tst emergency_preemptive_call.py: using MSISDN 8219 16:17:54.927841 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:55.482729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4920): Launched 16:17:55.795148 run osmo-msc_10.42.42.6(pid=4921): Launched 16:17:55.970023 run osmo-stp_10.42.42.5(pid=4918): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4918)] 16:17:56.119057 run osmo-stp_10.42.42.5(pid=4918): stdout: | (launched: 2022-12-13_16:17:54.585389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:56.259799 run osmo-stp_10.42.42.5(pid=4918): stderr: | [0;m[38;5;43m20221213161754758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161754758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161754758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161754759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161754759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161754759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161754759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:56.397789 run osmo-stp_10.42.42.5(pid=4918): stdout: | (launched: 2022-12-13_16:17:54.585389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:56.529508 run osmo-stp_10.42.42.5(pid=4918): stderr: | [0;m[38;5;43m20221213161754758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161754758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161754758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161754759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161754759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161754759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161754759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:56.687071 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4918): Process ended prematurely: osmo-stp_10.42.42.5(pid=4918) [trial-2391↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4918)] [trial-2391↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 16:17:56.696155 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 16:17:56.724408 run osmo-hlr_10.42.42.2(pid=4915): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4915)] 16:17:56.776686 run osmo-hlr_10.42.42.2(pid=4915): stdout: | (launched: 2022-12-13_16:17:53.625835) 16:17:56.830079 run osmo-hlr_10.42.42.2(pid=4915): stderr: | [0;m[1;31m20221213161753804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161753804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161753804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161753804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161753804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161753804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161753819 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161753828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161753829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161753829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:56.904868 run osmo-msc_10.42.42.6(pid=4921): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4921)] 16:17:56.955879 run osmo-msc_10.42.42.6(pid=4921): stdout: | (launched: 2022-12-13_16:17:55.737107) 16:17:57.009321 run osmo-msc_10.42.42.6(pid=4921): stderr: | [0;m[38;5;43m20221213161756008 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213161756008 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faa249edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213161756008 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213161756008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213161756008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213161756013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213161756015 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213161756015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213161756015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213161756016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:57.062535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4914): Terminating (SIGTERM) 16:17:57.106223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4917): Terminating (SIGTERM) 16:17:57.149673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4920): Terminating (SIGTERM) 16:17:57.193170 --- ParallelTerminationStrategy: PID 4914 died... 16:17:57.214200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4914): Terminated: ok {rc=0} 16:17:57.261905 --- ParallelTerminationStrategy: PID 4917 died... 16:17:57.282288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4917): Terminated: ok {rc=0} 16:17:57.329726 --- ParallelTerminationStrategy: PID 4920 died... 16:17:57.350141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4920): Terminated: ok {rc=0} 16:17:57.441253 bus /sierra_9: Setting Powered False 16:17:58.541615 bus /sierra_9: Setting Powered False 16:17:59.660118 bus /sierra_8: Setting Powered False 16:18:00.758623 bus /sierra_8: Setting Powered False 16:18:01.883246 bus /sierra_3: Setting Powered False 16:18:02.985374 bus /sierra_3: Setting Powered False 16:18:04.106286 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-umtrx --------------------------------------------------------------------- 16:18:05.395200 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:18:05.399973 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:18:05.433615 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 16:18:05.474586 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 16:18:05.564643 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:18:05.597545 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 16:18:05.636495 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 16:18:06.227673 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 16:18:06.279863 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:06.290817 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:18:06.338282 tst cs_paging_gprs_active.py: using LAC 34785 16:18:06.458628 tst cs_paging_gprs_active.py: using RAC 105 16:18:06.581276 tst cs_paging_gprs_active.py: using CellId 34785 16:18:06.712705 tst cs_paging_gprs_active.py: using BVCI 34786 16:18:06.827476 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:06.838447 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:06.849242 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:06.859777 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:06.870568 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:06.881353 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:06.891942 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:06.903014 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:06.913986 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:18:07.037911 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:18:07.157993 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:18:07.369511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:07.686757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4926): Launched 16:18:07.965660 run iperf3-srv_10.42.42.10(pid=4927): Launched 16:18:08.084273 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:18:08.295134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:08.611746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4928): Launched 16:18:08.890425 run iperf3-srv_10.42.42.10(pid=4929): Launched 16:18:09.010273 tst cs_paging_gprs_active.py:38: start network... 16:18:09.220224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:09.707202 run create_hlr_db(pid=4930): Launched 16:18:09.838379 bus /sierra_2: Setting Powered False 16:18:10.900551 run create_hlr_db(pid=4930): Terminated: ok {rc=0} 16:18:11.358909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4932): Launched 16:18:11.698714 run osmo-hlr_10.42.42.2(pid=4933): Launched 16:18:11.829130 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:12.407120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4935): Launched 16:18:12.745238 run osmo-stp_10.42.42.5(pid=4936): Launched 16:18:12.876726 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:13.455864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4938): Launched 16:18:13.586166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:13.870684 run patchelf(pid=4940): Launched 16:18:14.058352 run osmo-stp_10.42.42.5(pid=4936): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4936)] 16:18:14.200822 run osmo-stp_10.42.42.5(pid=4936): stdout: | (launched: 2022-12-13_16:18:12.683021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:14.344908 run osmo-stp_10.42.42.5(pid=4936): stderr: | [0;m[38;5;43m20221213161812877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161812877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161812877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161812878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161812878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161812878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161812878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:14.488936 run osmo-stp_10.42.42.5(pid=4936): stdout: | (launched: 2022-12-13_16:18:12.683021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:14.626697 run osmo-stp_10.42.42.5(pid=4936): stderr: | [0;m[38;5;43m20221213161812877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161812877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161812877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161812878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161812878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161812878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161812878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:14.789534 run patchelf(pid=4940): Terminating (SIGINT) 16:18:14.978495 run patchelf(pid=4940): Terminated: ok {rc=0} 16:18:15.114181 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4936): Process ended prematurely: osmo-stp_10.42.42.5(pid=4936) [trial-2391↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4936)] [trial-2391↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 16:18:15.124594 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:18:15.153507 run osmo-hlr_10.42.42.2(pid=4933): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4933)] 16:18:15.204467 run osmo-hlr_10.42.42.2(pid=4933): stdout: | (launched: 2022-12-13_16:18:11.636494) 16:18:15.257155 run osmo-hlr_10.42.42.2(pid=4933): stderr: | [0;m[1;31m20221213161811840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161811840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161811840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161811840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161811840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161811840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161811852 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161811860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161811861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161811861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:15.310082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4926): Terminating (SIGTERM) 16:18:15.351829 run iperf3-srv_10.42.42.10(pid=4927): Terminating (SIGTERM) 16:18:15.394409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4928): Terminating (SIGTERM) 16:18:15.437222 run iperf3-srv_10.42.42.10(pid=4929): Terminating (SIGTERM) 16:18:15.479795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4932): Terminating (SIGTERM) 16:18:15.521992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4935): Terminating (SIGTERM) 16:18:15.564371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4938): Terminating (SIGTERM) 16:18:15.608547 --- ParallelTerminationStrategy: PID 4926 died... 16:18:15.629408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4926): Terminated: ok {rc=0} 16:18:15.676410 --- ParallelTerminationStrategy: PID 4927 died... 16:18:15.696299 run iperf3-srv_10.42.42.10(pid=4927): Terminated {rc=256} 16:18:15.743255 --- ParallelTerminationStrategy: PID 4928 died... 16:18:15.763451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4928): Terminated: ok {rc=0} 16:18:15.810469 --- ParallelTerminationStrategy: PID 4929 died... 16:18:15.830895 run iperf3-srv_10.42.42.10(pid=4929): Terminated {rc=256} 16:18:15.885403 --- ParallelTerminationStrategy: PID 4932 died... 16:18:15.907426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4932): Terminated: ok {rc=0} 16:18:15.955352 --- ParallelTerminationStrategy: PID 4935 died... 16:18:15.975966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4935): Terminated: ok {rc=0} 16:18:16.023747 --- ParallelTerminationStrategy: PID 4938 died... 16:18:16.044288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4938): Terminated: ok {rc=0} 16:18:16.135191 bus /gobi_0: Setting Powered False 16:18:17.250177 bus /gobi_0: Setting Powered False 16:18:18.367540 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx iperf3.py ---------------------------------------------- 16:18:19.520279 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:19.532546 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:18:19.590970 tst iperf3.py: using LAC 34786 16:18:19.722725 tst iperf3.py: using RAC 106 16:18:19.852767 tst iperf3.py: using CellId 34786 16:18:19.983868 tst iperf3.py: using BVCI 34787 16:18:20.099069 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:20.110029 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:20.120493 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:20.131103 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:20.141646 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:20.152081 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:20.162733 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:20.173219 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:20.183786 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:18:20.307040 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:18:20.534936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:20.874668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4942): Launched 16:18:21.171517 run iperf3-srv_10.42.42.10(pid=4943): Launched 16:18:21.298609 tst iperf3.py:8: start network... 16:18:21.526426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:22.048739 run create_hlr_db(pid=4944): Launched 16:18:22.177849 bus /gobi_6: Setting Powered False 16:18:23.243808 run create_hlr_db(pid=4944): Terminated: ok {rc=0} 16:18:23.691894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4946): Launched 16:18:24.010967 run osmo-hlr_10.42.42.2(pid=4947): Launched 16:18:24.132702 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:24.674495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4949): Launched 16:18:24.989783 run osmo-stp_10.42.42.5(pid=4950): Launched 16:18:25.111876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:25.653647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4952): Launched 16:18:25.774338 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:26.040463 run patchelf(pid=4953): Launched 16:18:26.216872 run osmo-stp_10.42.42.5(pid=4950): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4950)] 16:18:26.349956 run osmo-stp_10.42.42.5(pid=4950): stdout: | (launched: 2022-12-13_16:18:24.931413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:26.484448 run osmo-stp_10.42.42.5(pid=4950): stderr: | [0;m[38;5;43m20221213161825106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161825106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161825106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161825106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161825107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161825107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161825107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:26.619191 run osmo-stp_10.42.42.5(pid=4950): stdout: | (launched: 2022-12-13_16:18:24.931413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:26.748926 run osmo-stp_10.42.42.5(pid=4950): stderr: | [0;m[38;5;43m20221213161825106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161825106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161825106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161825106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161825107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161825107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161825107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:26.901524 run patchelf(pid=4953): Terminating (SIGINT) 16:18:27.078501 run patchelf(pid=4953): Terminated: ok {rc=0} 16:18:27.206222 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4950): Process ended prematurely: osmo-stp_10.42.42.5(pid=4950) [trial-2391↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4950)] [trial-2391↪gprs:trx-umtrx↪iperf3.py:8] 16:18:27.215804 tst iperf3.py:8: Test FAILED (7.7 sec) 16:18:27.243192 run osmo-hlr_10.42.42.2(pid=4947): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4947)] 16:18:27.290992 run osmo-hlr_10.42.42.2(pid=4947): stdout: | (launched: 2022-12-13_16:18:23.952119) 16:18:27.340485 run osmo-hlr_10.42.42.2(pid=4947): stderr: | [0;m[1;31m20221213161824130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161824130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161824130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161824130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161824130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161824130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161824142 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161824150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161824151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161824151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:27.390632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4942): Terminating (SIGTERM) 16:18:27.430537 run iperf3-srv_10.42.42.10(pid=4943): Terminating (SIGTERM) 16:18:27.470215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4946): Terminating (SIGTERM) 16:18:27.510087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4949): Terminating (SIGTERM) 16:18:27.549548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4952): Terminating (SIGTERM) 16:18:27.589623 --- ParallelTerminationStrategy: PID 4942 died... 16:18:27.608633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4942): Terminated: ok {rc=0} 16:18:27.652657 --- ParallelTerminationStrategy: PID 4943 died... 16:18:27.671388 run iperf3-srv_10.42.42.10(pid=4943): Terminated {rc=256} 16:18:27.714847 --- ParallelTerminationStrategy: PID 4946 died... 16:18:27.733350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4946): Terminated: ok {rc=0} 16:18:27.776761 --- ParallelTerminationStrategy: PID 4949 died... 16:18:27.795438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4949): Terminated: ok {rc=0} 16:18:27.838953 --- ParallelTerminationStrategy: PID 4952 died... 16:18:27.857959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4952): Terminated: ok {rc=0} 16:18:27.941501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 16:18:29.092823 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:29.105120 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:18:29.156745 tst iperf3m4.py: using LAC 34787 16:18:29.286195 tst iperf3m4.py: using RAC 107 16:18:29.417038 tst iperf3m4.py: using CellId 34787 16:18:29.546672 tst iperf3m4.py: using BVCI 34788 16:18:29.668549 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:29.680073 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:29.691160 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:29.702222 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:29.713622 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:29.724802 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:29.736389 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:29.747876 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:29.759456 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:18:29.880238 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:18:30.010584 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:18:30.130017 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:18:30.252364 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:18:30.479497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:30.817585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4954): Launched 16:18:31.128446 run iperf3-srv_10.42.42.10(pid=4955): Launched 16:18:31.265151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:18:31.482510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:31.815637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4956): Launched 16:18:32.173799 run iperf3-srv_10.42.42.10(pid=4957): Launched 16:18:32.310271 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:18:32.537483 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:32.877214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4958): Launched 16:18:33.172665 run iperf3-srv_10.42.42.10(pid=4959): Launched 16:18:33.300617 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:18:33.527151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:33.866330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4960): Launched 16:18:34.161194 run iperf3-srv_10.42.42.10(pid=4961): Launched 16:18:34.287408 tst iperf3m4.py:8: start network... 16:18:34.513348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:35.034618 run create_hlr_db(pid=4962): Launched 16:18:35.164040 bus /gobi_6: Setting Powered False 16:18:36.230361 run create_hlr_db(pid=4962): Terminated: ok {rc=0} 16:18:36.680031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4964): Launched 16:18:36.996904 run osmo-hlr_10.42.42.2(pid=4965): Launched 16:18:37.119135 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:37.675823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4967): Launched 16:18:37.995713 run osmo-stp_10.42.42.5(pid=4968): Launched 16:18:38.118160 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:38.659886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4970): Launched 16:18:38.782427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:39.049696 run patchelf(pid=4971): Launched 16:18:39.224781 run osmo-stp_10.42.42.5(pid=4968): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4968)] 16:18:39.356866 run osmo-stp_10.42.42.5(pid=4968): stdout: | (launched: 2022-12-13_16:18:37.936193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:39.491272 run osmo-stp_10.42.42.5(pid=4968): stderr: | [0;m[38;5;43m20221213161838110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161838110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161838110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161838110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161838111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161838111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161838111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:39.625789 run osmo-stp_10.42.42.5(pid=4968): stdout: | (launched: 2022-12-13_16:18:37.936193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:39.754039 run osmo-stp_10.42.42.5(pid=4968): stderr: | [0;m[38;5;43m20221213161838110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161838110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161838110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161838110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161838111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161838111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161838111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:39.905832 run patchelf(pid=4971): Terminating (SIGINT) 16:18:40.083327 run patchelf(pid=4971): Terminated: ok {rc=0} 16:18:40.210478 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4968): Process ended prematurely: osmo-stp_10.42.42.5(pid=4968) [trial-2391↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4968)] [trial-2391↪gprs:trx-umtrx↪iperf3m4.py:8] 16:18:40.219925 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:18:40.247664 run osmo-hlr_10.42.42.2(pid=4965): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4965)] 16:18:40.295254 run osmo-hlr_10.42.42.2(pid=4965): stdout: | (launched: 2022-12-13_16:18:36.937799) 16:18:40.344660 run osmo-hlr_10.42.42.2(pid=4965): stderr: | [0;m[1;31m20221213161837118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161837118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161837118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161837118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161837118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161837118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161837130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161837138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161837138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161837138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:40.394370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4954): Terminating (SIGTERM) 16:18:40.434065 run iperf3-srv_10.42.42.10(pid=4955): Terminating (SIGTERM) 16:18:40.473684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4956): Terminating (SIGTERM) 16:18:40.513746 run iperf3-srv_10.42.42.10(pid=4957): Terminating (SIGTERM) 16:18:40.553611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4958): Terminating (SIGTERM) 16:18:40.593638 run iperf3-srv_10.42.42.10(pid=4959): Terminating (SIGTERM) 16:18:40.633448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4960): Terminating (SIGTERM) 16:18:40.673279 run iperf3-srv_10.42.42.10(pid=4961): Terminating (SIGTERM) 16:18:40.713466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4964): Terminating (SIGTERM) 16:18:40.753625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4967): Terminating (SIGTERM) 16:18:40.793316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4970): Terminating (SIGTERM) 16:18:40.833975 --- ParallelTerminationStrategy: PID 4954 died... 16:18:40.853361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4954): Terminated: ok {rc=0} 16:18:40.897325 --- ParallelTerminationStrategy: PID 4955 died... 16:18:40.915781 run iperf3-srv_10.42.42.10(pid=4955): Terminated {rc=256} 16:18:40.959705 --- ParallelTerminationStrategy: PID 4956 died... 16:18:40.978514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4956): Terminated: ok {rc=0} 16:18:41.022537 --- ParallelTerminationStrategy: PID 4957 died... 16:18:41.041220 run iperf3-srv_10.42.42.10(pid=4957): Terminated {rc=256} 16:18:41.084788 --- ParallelTerminationStrategy: PID 4958 died... 16:18:41.103643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4958): Terminated: ok {rc=0} 16:18:41.147581 --- ParallelTerminationStrategy: PID 4959 died... 16:18:41.166321 run iperf3-srv_10.42.42.10(pid=4959): Terminated {rc=256} 16:18:41.210264 --- ParallelTerminationStrategy: PID 4960 died... 16:18:41.229260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4960): Terminated: ok {rc=0} 16:18:41.273350 --- ParallelTerminationStrategy: PID 4961 died... 16:18:41.292008 run iperf3-srv_10.42.42.10(pid=4961): Terminated {rc=256} 16:18:41.335763 --- ParallelTerminationStrategy: PID 4964 died... 16:18:41.354578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4964): Terminated: ok {rc=0} 16:18:41.398457 --- ParallelTerminationStrategy: PID 4967 died... 16:18:41.417276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4967): Terminated: ok {rc=0} 16:18:41.460939 --- ParallelTerminationStrategy: PID 4970 died... 16:18:41.479859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4970): Terminated: ok {rc=0} 16:18:41.565573 bus /gobi_4: Setting Powered False 16:18:42.665446 bus /gobi_4: Setting Powered False 16:18:43.779683 bus /gobi_1: Setting Powered False 16:18:44.878258 bus /gobi_1: Setting Powered False 16:18:46.008130 bus /gobi_0: Setting Powered False 16:18:47.122587 bus /gobi_0: Setting Powered False 16:18:48.238215 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx ping.py ---------------------------------------------- 16:18:49.342321 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:49.354870 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:18:49.405699 tst ping.py: using LAC 34788 16:18:49.536243 tst ping.py: using RAC 108 16:18:49.664521 tst ping.py: using CellId 34788 16:18:49.794664 tst ping.py: using BVCI 34789 16:18:49.916669 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:49.928055 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:49.939150 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:49.950305 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:49.961658 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:49.972871 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:49.984397 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:49.995836 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:18:50.118581 tst ping.py:19: start network... 16:18:50.341137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:50.851063 run create_hlr_db(pid=4972): Launched 16:18:50.978618 bus /gobi_6: Setting Powered False 16:18:52.042651 run create_hlr_db(pid=4972): Terminated: ok {rc=0} 16:18:52.484078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4974): Launched 16:18:52.795896 run osmo-hlr_10.42.42.2(pid=4975): Launched 16:18:52.915058 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:53.447900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4977): Launched 16:18:53.757797 run osmo-stp_10.42.42.5(pid=4978): Launched 16:18:53.877315 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:54.408917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4980): Launched 16:18:54.528008 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:54.788669 run patchelf(pid=4981): Launched 16:18:54.961775 run osmo-stp_10.42.42.5(pid=4978): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4978)] 16:18:55.092024 run osmo-stp_10.42.42.5(pid=4978): stdout: | (launched: 2022-12-13_16:18:53.699936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:55.224191 run osmo-stp_10.42.42.5(pid=4978): stderr: | [0;m[38;5;43m20221213161853873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161853873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161853874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161853874 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161853876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161853877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161853877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:55.357251 run osmo-stp_10.42.42.5(pid=4978): stdout: | (launched: 2022-12-13_16:18:53.699936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:55.482867 run osmo-stp_10.42.42.5(pid=4978): stderr: | [0;m[38;5;43m20221213161853873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161853873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161853874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161853874 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161853876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161853877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161853877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:55.632257 run patchelf(pid=4981): Terminating (SIGINT) 16:18:55.805152 run patchelf(pid=4981): Terminated: ok {rc=0} 16:18:55.930168 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4978): Process ended prematurely: osmo-stp_10.42.42.5(pid=4978) [trial-2391↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4978)] [trial-2391↪gprs:trx-umtrx↪ping.py:22] 16:18:55.939137 tst ping.py:22: Test FAILED (6.6 sec) 16:18:55.966147 run osmo-hlr_10.42.42.2(pid=4975): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4975)] 16:18:56.013815 run osmo-hlr_10.42.42.2(pid=4975): stdout: | (launched: 2022-12-13_16:18:52.738081) 16:18:56.063281 run osmo-hlr_10.42.42.2(pid=4975): stderr: | [0;m[1;31m20221213161852919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161852919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161852919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161852919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161852919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161852919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161852931 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161852940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161852940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161852940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:56.114423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4974): Terminating (SIGTERM) 16:18:56.154497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4977): Terminating (SIGTERM) 16:18:56.194572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4980): Terminating (SIGTERM) 16:18:56.234772 --- ParallelTerminationStrategy: PID 4974 died... 16:18:56.254025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4974): Terminated: ok {rc=0} 16:18:56.298094 --- ParallelTerminationStrategy: PID 4977 died... 16:18:56.316687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4977): Terminated: ok {rc=0} 16:18:56.360718 --- ParallelTerminationStrategy: PID 4980 died... 16:18:56.379464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4980): Terminated: ok {rc=0} 16:18:56.467059 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 16:18:57.556545 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:57.568131 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:18:57.619472 tst ping_idle_ping.py: using LAC 34789 16:18:57.741543 tst ping_idle_ping.py: using RAC 109 16:18:57.872671 tst ping_idle_ping.py: using CellId 34789 16:18:58.002684 tst ping_idle_ping.py: using BVCI 34790 16:18:58.124739 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:58.136306 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:58.147777 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:58.159106 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:58.170609 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:58.182150 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:58.193689 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:18:58.205349 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:18:58.322532 tst ping_idle_ping.py:24: start network... 16:18:58.529812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:59.011911 run create_hlr_db(pid=4982): Launched 16:18:59.140528 bus /gobi_6: Setting Powered False 16:19:00.202292 run create_hlr_db(pid=4982): Terminated: ok {rc=0} 16:19:00.655593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4984): Launched 16:19:01.017496 run osmo-hlr_10.42.42.2(pid=4985): Launched 16:19:01.321837 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:01.996851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4987): Launched 16:19:02.346767 run osmo-stp_10.42.42.5(pid=4988): Launched 16:19:02.503992 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:03.043852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4990): Launched 16:19:03.165814 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:03.428802 run patchelf(pid=4991): Launched 16:19:03.603441 run osmo-stp_10.42.42.5(pid=4988): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4988)] 16:19:03.733979 run osmo-stp_10.42.42.5(pid=4988): stdout: | (launched: 2022-12-13_16:19:02.285679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:03.866285 run osmo-stp_10.42.42.5(pid=4988): stderr: | [0;m[38;5;43m20221213161902487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161902487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161902488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161902488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161902490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161902490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161902491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:03.999320 run osmo-stp_10.42.42.5(pid=4988): stdout: | (launched: 2022-12-13_16:19:02.285679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:04.125303 run osmo-stp_10.42.42.5(pid=4988): stderr: | [0;m[38;5;43m20221213161902487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161902487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161902488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161902488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161902490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161902490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161902491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:04.275971 run patchelf(pid=4991): Terminating (SIGINT) 16:19:04.449438 run patchelf(pid=4991): Terminated: ok {rc=0} 16:19:04.574221 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4988): Process ended prematurely: osmo-stp_10.42.42.5(pid=4988) [trial-2391↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4988)] [trial-2391↪gprs:trx-umtrx↪ping_idle_ping.py:27] 16:19:04.583260 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 16:19:04.610122 run osmo-hlr_10.42.42.2(pid=4985): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4985)] 16:19:04.658209 run osmo-hlr_10.42.42.2(pid=4985): stdout: | (launched: 2022-12-13_16:19:00.954923) 16:19:04.707794 run osmo-hlr_10.42.42.2(pid=4985): stderr: | [0;m[1;31m20221213161901275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161901275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161901275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161901275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161901276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161901276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161901296 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161901314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161901315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161901315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:04.757924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4984): Terminating (SIGTERM) 16:19:04.798044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4987): Terminating (SIGTERM) 16:19:04.838227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4990): Terminating (SIGTERM) 16:19:04.878679 --- ParallelTerminationStrategy: PID 4984 died... 16:19:04.898370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4984): Terminated: ok {rc=0} 16:19:04.943100 --- ParallelTerminationStrategy: PID 4987 died... 16:19:04.962155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4987): Terminated: ok {rc=0} 16:19:05.006733 --- ParallelTerminationStrategy: PID 4990 died... 16:19:05.025884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4990): Terminated: ok {rc=0} 16:19:05.112580 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 16:19:06.415145 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:19:06.420654 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:19:06.453206 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:19:06.493449 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:19:06.582914 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:19:06.615514 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:19:06.654795 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:19:07.247854 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:19:07.299582 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:07.310572 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:19:07.368872 tst cs_paging_gprs_active.py: using LAC 34790 16:19:07.513167 tst cs_paging_gprs_active.py: using RAC 110 16:19:07.646742 tst cs_paging_gprs_active.py: using CellId 34790 16:19:07.781221 tst cs_paging_gprs_active.py: using BVCI 34791 16:19:07.904161 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:07.915986 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:07.927442 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:07.939088 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:07.950834 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:07.962732 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:07.974959 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:07.986797 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:07.999007 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:19:08.119493 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:19:08.243177 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:19:08.472060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:08.812261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4997): Launched 16:19:09.108836 run iperf3-srv_10.42.42.10(pid=4998): Launched 16:19:09.237575 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:19:09.466124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:09.806867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4999): Launched 16:19:10.104576 run iperf3-srv_10.42.42.10(pid=5000): Launched 16:19:10.233569 tst cs_paging_gprs_active.py:38: start network... 16:19:10.461888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:10.986187 run create_hlr_db(pid=5001): Launched 16:19:11.117123 bus /gobi_6: Setting Powered False 16:19:12.182859 run create_hlr_db(pid=5001): Terminated: ok {rc=0} 16:19:12.633546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5003): Launched 16:19:12.952217 run osmo-hlr_10.42.42.2(pid=5004): Launched 16:19:13.072730 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:13.616249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5006): Launched 16:19:13.935004 run osmo-stp_10.42.42.5(pid=5007): Launched 16:19:14.057085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:14.602341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5009): Launched 16:19:14.725086 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:14.991796 run patchelf(pid=5010): Launched 16:19:15.168812 run osmo-stp_10.42.42.5(pid=5007): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5007)] 16:19:15.301817 run osmo-stp_10.42.42.5(pid=5007): stdout: | (launched: 2022-12-13_16:19:13.875985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:15.436384 run osmo-stp_10.42.42.5(pid=5007): stderr: | [0;m[38;5;43m20221213161914049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161914049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161914049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161914050 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161914052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161914052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161914052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:15.570801 run osmo-stp_10.42.42.5(pid=5007): stdout: | (launched: 2022-12-13_16:19:13.875985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:15.699273 run osmo-stp_10.42.42.5(pid=5007): stderr: | [0;m[38;5;43m20221213161914049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161914049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161914049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161914050 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161914052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161914052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161914052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:15.856196 run patchelf(pid=5010): Terminating (SIGINT) 16:19:16.065074 run patchelf(pid=5010): Terminated: ok {rc=0} 16:19:16.205153 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5007): Process ended prematurely: osmo-stp_10.42.42.5(pid=5007) [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5007)] [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:19:16.216349 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:19:16.247117 run osmo-hlr_10.42.42.2(pid=5004): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5004)] 16:19:16.303233 run osmo-hlr_10.42.42.2(pid=5004): stdout: | (launched: 2022-12-13_16:19:12.893341) 16:19:16.358556 run osmo-hlr_10.42.42.2(pid=5004): stderr: | [0;m[1;31m20221213161913071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161913071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161913071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161913071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161913071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161913071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161913084 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161913092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161913093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161913093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:16.414089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4997): Terminating (SIGTERM) 16:19:16.458882 run iperf3-srv_10.42.42.10(pid=4998): Terminating (SIGTERM) 16:19:16.503938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4999): Terminating (SIGTERM) 16:19:16.548784 run iperf3-srv_10.42.42.10(pid=5000): Terminating (SIGTERM) 16:19:16.594525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5003): Terminating (SIGTERM) 16:19:16.639463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5006): Terminating (SIGTERM) 16:19:16.687325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5009): Terminating (SIGTERM) 16:19:16.734769 --- ParallelTerminationStrategy: PID 4997 died... 16:19:16.757175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4997): Terminated: ok {rc=0} 16:19:16.807756 --- ParallelTerminationStrategy: PID 4998 died... 16:19:16.828509 run iperf3-srv_10.42.42.10(pid=4998): Terminated {rc=256} 16:19:16.877963 --- ParallelTerminationStrategy: PID 4999 died... 16:19:16.899508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4999): Terminated: ok {rc=0} 16:19:16.948026 --- ParallelTerminationStrategy: PID 5000 died... 16:19:16.969585 run iperf3-srv_10.42.42.10(pid=5000): Terminated {rc=256} 16:19:17.018509 --- ParallelTerminationStrategy: PID 5003 died... 16:19:17.039971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5003): Terminated: ok {rc=0} 16:19:17.089404 --- ParallelTerminationStrategy: PID 5006 died... 16:19:17.111121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5006): Terminated: ok {rc=0} 16:19:17.159761 --- ParallelTerminationStrategy: PID 5009 died... 16:19:17.182043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5009): Terminated: ok {rc=0} 16:19:17.272764 bus /gobi_0: Setting Powered False 16:19:18.373663 bus /gobi_0: Setting Powered False 16:19:19.491195 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:19:20.637162 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:20.649104 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:19:20.702262 tst iperf3.py: using LAC 34791 16:19:20.827823 tst iperf3.py: using RAC 111 16:19:20.951425 tst iperf3.py: using CellId 34791 16:19:21.076835 tst iperf3.py: using BVCI 34792 16:19:21.193136 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:21.204149 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:21.214905 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:21.225712 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:21.236319 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:21.247720 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:21.259302 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:21.270422 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:21.281674 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:19:21.401099 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:19:21.613205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:21.932101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5011): Launched 16:19:22.211017 run iperf3-srv_10.42.42.10(pid=5012): Launched 16:19:22.333153 tst iperf3.py:8: start network... 16:19:22.544879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:23.033314 run create_hlr_db(pid=5013): Launched 16:19:23.162619 bus /gobi_6: Setting Powered False 16:19:24.224537 run create_hlr_db(pid=5013): Terminated: ok {rc=0} 16:19:24.683686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5015): Launched 16:19:25.021693 run osmo-hlr_10.42.42.2(pid=5016): Launched 16:19:25.150430 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:25.733435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5018): Launched 16:19:26.071137 run osmo-stp_10.42.42.5(pid=5019): Launched 16:19:26.199284 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:26.778546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5021): Launched 16:19:26.909508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:27.194677 run patchelf(pid=5022): Launched 16:19:27.381451 run osmo-stp_10.42.42.5(pid=5019): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5019)] 16:19:27.523616 run osmo-stp_10.42.42.5(pid=5019): stdout: | (launched: 2022-12-13_16:19:26.008595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:27.667745 run osmo-stp_10.42.42.5(pid=5019): stderr: | [0;m[38;5;43m20221213161926205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161926205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161926205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161926205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161926206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161926206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161926206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:27.811642 run osmo-stp_10.42.42.5(pid=5019): stdout: | (launched: 2022-12-13_16:19:26.008595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:27.949466 run osmo-stp_10.42.42.5(pid=5019): stderr: | [0;m[38;5;43m20221213161926205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161926205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161926205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161926205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161926206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161926206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161926206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:28.112050 run patchelf(pid=5022): Terminating (SIGINT) 16:19:28.301142 run patchelf(pid=5022): Terminated: ok {rc=0} 16:19:28.437518 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5019): Process ended prematurely: osmo-stp_10.42.42.5(pid=5019) [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5019)] [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 16:19:28.447894 tst iperf3.py:8: Test FAILED (7.8 sec) 16:19:28.476791 run osmo-hlr_10.42.42.2(pid=5016): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5016)] 16:19:28.528071 run osmo-hlr_10.42.42.2(pid=5016): stdout: | (launched: 2022-12-13_16:19:24.959509) 16:19:28.580472 run osmo-hlr_10.42.42.2(pid=5016): stderr: | [0;m[1;31m20221213161925161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161925161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161925161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161925161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161925161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161925161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161925172 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161925181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161925181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161925181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:28.633743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5011): Terminating (SIGTERM) 16:19:28.676222 run iperf3-srv_10.42.42.10(pid=5012): Terminating (SIGTERM) 16:19:28.718596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5015): Terminating (SIGTERM) 16:19:28.761150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5018): Terminating (SIGTERM) 16:19:28.803379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5021): Terminating (SIGTERM) 16:19:28.845821 --- ParallelTerminationStrategy: PID 5011 died... 16:19:28.866517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5011): Terminated: ok {rc=0} 16:19:28.913587 --- ParallelTerminationStrategy: PID 5012 died... 16:19:28.933651 run iperf3-srv_10.42.42.10(pid=5012): Terminated {rc=256} 16:19:28.980020 --- ParallelTerminationStrategy: PID 5015 died... 16:19:29.000091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5015): Terminated: ok {rc=0} 16:19:29.046491 --- ParallelTerminationStrategy: PID 5018 died... 16:19:29.066503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5018): Terminated: ok {rc=0} 16:19:29.112605 --- ParallelTerminationStrategy: PID 5021 died... 16:19:29.132565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5021): Terminated: ok {rc=0} 16:19:29.220882 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:19:30.372496 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:30.384934 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:19:30.437625 tst iperf3m4.py: using LAC 34792 16:19:30.569615 tst iperf3m4.py: using RAC 112 16:19:30.693768 tst iperf3m4.py: using CellId 34792 16:19:30.816793 tst iperf3m4.py: using BVCI 34793 16:19:30.963985 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:30.976749 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:30.989255 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:31.001749 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:31.015099 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:31.028403 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:31.042282 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:31.056372 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:31.069519 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:19:31.193295 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:19:31.330997 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:19:31.478634 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:19:31.627984 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:19:31.902014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:32.251344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5023): Launched 16:19:32.558510 run iperf3-srv_10.42.42.10(pid=5024): Launched 16:19:32.685762 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:19:32.914106 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:33.254323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5025): Launched 16:19:33.551599 run iperf3-srv_10.42.42.10(pid=5026): Launched 16:19:33.680747 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:19:33.909485 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:34.250646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5027): Launched 16:19:34.547777 run iperf3-srv_10.42.42.10(pid=5028): Launched 16:19:34.674953 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:19:34.903016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:35.243404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5029): Launched 16:19:35.539338 run iperf3-srv_10.42.42.10(pid=5030): Launched 16:19:35.666439 tst iperf3m4.py:8: start network... 16:19:35.894406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:36.418866 run create_hlr_db(pid=5031): Launched 16:19:36.549160 bus /gobi_6: Setting Powered False 16:19:37.611945 run create_hlr_db(pid=5031): Terminated: ok {rc=0} 16:19:38.082087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5033): Launched 16:19:38.421627 run osmo-hlr_10.42.42.2(pid=5034): Launched 16:19:38.552030 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:39.137423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5036): Launched 16:19:39.475126 run osmo-stp_10.42.42.5(pid=5037): Launched 16:19:39.605990 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:40.188604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5039): Launched 16:19:40.319060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:40.604544 run patchelf(pid=5040): Launched 16:19:40.792485 run osmo-stp_10.42.42.5(pid=5037): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5037)] 16:19:40.935564 run osmo-stp_10.42.42.5(pid=5037): stdout: | (launched: 2022-12-13_16:19:39.412711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:41.080266 run osmo-stp_10.42.42.5(pid=5037): stderr: | [0;m[38;5;43m20221213161939606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161939607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161939607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161939607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161939608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161939608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161939608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:41.225103 run osmo-stp_10.42.42.5(pid=5037): stdout: | (launched: 2022-12-13_16:19:39.412711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:41.362903 run osmo-stp_10.42.42.5(pid=5037): stderr: | [0;m[38;5;43m20221213161939606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161939607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161939607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161939607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161939608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161939608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161939608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:41.526617 run patchelf(pid=5040): Terminating (SIGINT) 16:19:41.715814 run patchelf(pid=5040): Terminated: ok {rc=0} 16:19:41.852293 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5037): Process ended prematurely: osmo-stp_10.42.42.5(pid=5037) [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5037)] [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 16:19:41.862656 tst iperf3m4.py:8: Test FAILED (11.5 sec) 16:19:41.892182 run osmo-hlr_10.42.42.2(pid=5034): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5034)] 16:19:41.944033 run osmo-hlr_10.42.42.2(pid=5034): stdout: | (launched: 2022-12-13_16:19:38.358151) 16:19:41.997330 run osmo-hlr_10.42.42.2(pid=5034): stderr: | [0;m[1;31m20221213161938560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161938560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161938560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161938560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161938560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161938560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161938576 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161938584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161938584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161938584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:42.050556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5023): Terminating (SIGTERM) 16:19:42.092783 run iperf3-srv_10.42.42.10(pid=5024): Terminating (SIGTERM) 16:19:42.135325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5025): Terminating (SIGTERM) 16:19:42.178035 run iperf3-srv_10.42.42.10(pid=5026): Terminating (SIGTERM) 16:19:42.220412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5027): Terminating (SIGTERM) 16:19:42.263594 run iperf3-srv_10.42.42.10(pid=5028): Terminating (SIGTERM) 16:19:42.306287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5029): Terminating (SIGTERM) 16:19:42.349242 run iperf3-srv_10.42.42.10(pid=5030): Terminating (SIGTERM) 16:19:42.391709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5033): Terminating (SIGTERM) 16:19:42.434642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5036): Terminating (SIGTERM) 16:19:42.477478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5039): Terminating (SIGTERM) 16:19:42.520475 --- ParallelTerminationStrategy: PID 5023 died... 16:19:42.541387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5023): Terminated: ok {rc=0} 16:19:42.588385 --- ParallelTerminationStrategy: PID 5024 died... 16:19:42.608428 run iperf3-srv_10.42.42.10(pid=5024): Terminated {rc=256} 16:19:42.655579 --- ParallelTerminationStrategy: PID 5025 died... 16:19:42.675833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5025): Terminated: ok {rc=0} 16:19:42.722555 --- ParallelTerminationStrategy: PID 5026 died... 16:19:42.742545 run iperf3-srv_10.42.42.10(pid=5026): Terminated {rc=256} 16:19:42.789452 --- ParallelTerminationStrategy: PID 5027 died... 16:19:42.809624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5027): Terminated: ok {rc=0} 16:19:42.856331 --- ParallelTerminationStrategy: PID 5028 died... 16:19:42.876515 run iperf3-srv_10.42.42.10(pid=5028): Terminated {rc=256} 16:19:42.923679 --- ParallelTerminationStrategy: PID 5029 died... 16:19:42.943871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5029): Terminated: ok {rc=0} 16:19:42.990774 --- ParallelTerminationStrategy: PID 5030 died... 16:19:43.010988 run iperf3-srv_10.42.42.10(pid=5030): Terminated {rc=256} 16:19:43.057712 --- ParallelTerminationStrategy: PID 5033 died... 16:19:43.077984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5033): Terminated: ok {rc=0} 16:19:43.124926 --- ParallelTerminationStrategy: PID 5036 died... 16:19:43.145616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5036): Terminated: ok {rc=0} 16:19:43.192685 --- ParallelTerminationStrategy: PID 5039 died... 16:19:43.213028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5039): Terminated: ok {rc=0} 16:19:43.302505 bus /gobi_4: Setting Powered False 16:19:44.399271 bus /gobi_4: Setting Powered False 16:19:45.514134 bus /gobi_1: Setting Powered False 16:19:46.610401 bus /gobi_1: Setting Powered False 16:19:47.732243 bus /gobi_0: Setting Powered False 16:19:48.831075 bus /gobi_0: Setting Powered False 16:19:49.949353 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 16:19:51.052819 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:51.065195 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:19:51.118797 tst ping.py: using LAC 34793 16:19:51.248034 tst ping.py: using RAC 113 16:19:51.376394 tst ping.py: using CellId 34793 16:19:51.505344 tst ping.py: using BVCI 34794 16:19:51.626605 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:51.638185 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:51.649671 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:51.660906 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:51.672504 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:51.684130 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:51.695968 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:51.707586 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:19:51.829977 tst ping.py:19: start network... 16:19:52.053299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:52.564674 run create_hlr_db(pid=5041): Launched 16:19:52.692327 bus /gobi_6: Setting Powered False 16:19:53.757890 run create_hlr_db(pid=5041): Terminated: ok {rc=0} 16:19:54.202146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5043): Launched 16:19:54.514538 run osmo-hlr_10.42.42.2(pid=5044): Launched 16:19:54.637528 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:55.173448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5046): Launched 16:19:55.482651 run osmo-stp_10.42.42.5(pid=5047): Launched 16:19:55.601972 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:56.135014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5049): Launched 16:19:56.254549 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:56.516327 run patchelf(pid=5050): Launched 16:19:56.691809 run osmo-stp_10.42.42.5(pid=5047): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5047)] 16:19:56.822096 run osmo-stp_10.42.42.5(pid=5047): stdout: | (launched: 2022-12-13_16:19:55.424550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:56.954566 run osmo-stp_10.42.42.5(pid=5047): stderr: | [0;m[38;5;43m20221213161955596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161955596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161955597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161955597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161955599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161955599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161955599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:57.087014 run osmo-stp_10.42.42.5(pid=5047): stdout: | (launched: 2022-12-13_16:19:55.424550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:57.212634 run osmo-stp_10.42.42.5(pid=5047): stderr: | [0;m[38;5;43m20221213161955596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213161955596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213161955597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213161955597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213161955599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213161955599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213161955599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:57.362030 run patchelf(pid=5050): Terminating (SIGINT) 16:19:57.535329 run patchelf(pid=5050): Terminated: ok {rc=0} 16:19:57.660115 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5047): Process ended prematurely: osmo-stp_10.42.42.5(pid=5047) [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5047)] [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 16:19:57.669184 tst ping.py:22: Test FAILED (6.6 sec) 16:19:57.696341 run osmo-hlr_10.42.42.2(pid=5044): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5044)] 16:19:57.744487 run osmo-hlr_10.42.42.2(pid=5044): stdout: | (launched: 2022-12-13_16:19:54.456374) 16:19:57.794488 run osmo-hlr_10.42.42.2(pid=5044): stderr: | [0;m[1;31m20221213161954636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213161954636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213161954636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213161954636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213161954636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213161954636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213161954652 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213161954660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213161954660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213161954660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:57.845072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5043): Terminating (SIGTERM) 16:19:57.885568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5046): Terminating (SIGTERM) 16:19:57.925844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5049): Terminating (SIGTERM) 16:19:57.966545 --- ParallelTerminationStrategy: PID 5043 died... 16:19:57.985924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5043): Terminated: ok {rc=0} 16:19:58.030702 --- ParallelTerminationStrategy: PID 5046 died... 16:19:58.049578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5046): Terminated: ok {rc=0} 16:19:58.094060 --- ParallelTerminationStrategy: PID 5049 died... 16:19:58.113201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5049): Terminated: ok {rc=0} 16:19:58.199932 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:19:59.289031 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:59.301035 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:19:59.351690 tst ping_idle_ping.py: using LAC 34794 16:19:59.474692 tst ping_idle_ping.py: using RAC 114 16:19:59.600242 tst ping_idle_ping.py: using CellId 34794 16:19:59.721475 tst ping_idle_ping.py: using BVCI 34795 16:19:59.835386 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:59.846596 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:59.857383 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:59.868180 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:59.879113 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:59.889952 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:59.901463 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:19:59.912404 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:20:00.030373 tst ping_idle_ping.py:24: start network... 16:20:00.238387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:00.723660 run create_hlr_db(pid=5051): Launched 16:20:00.869865 bus /gobi_6: Setting Powered False 16:20:01.931996 run create_hlr_db(pid=5051): Terminated: ok {rc=0} 16:20:02.420842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5056): Launched 16:20:02.735954 run osmo-hlr_10.42.42.2(pid=5057): Launched 16:20:02.855926 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:03.390226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5059): Launched 16:20:03.702043 run osmo-stp_10.42.42.5(pid=5060): Launched 16:20:03.822743 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:04.358745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5062): Launched 16:20:04.479546 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:04.743725 run patchelf(pid=5063): Launched 16:20:04.918256 run osmo-stp_10.42.42.5(pid=5060): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5060)] 16:20:05.049700 run osmo-stp_10.42.42.5(pid=5060): stdout: | (launched: 2022-12-13_16:20:03.643787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:05.183574 run osmo-stp_10.42.42.5(pid=5060): stderr: | [0;m[38;5;43m20221213162003817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162003817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162003818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162003818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162003819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162003819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162003819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:05.317494 run osmo-stp_10.42.42.5(pid=5060): stdout: | (launched: 2022-12-13_16:20:03.643787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:05.444217 run osmo-stp_10.42.42.5(pid=5060): stderr: | [0;m[38;5;43m20221213162003817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162003817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162003818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162003818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162003819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162003819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162003819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:05.595162 run patchelf(pid=5063): Terminating (SIGINT) 16:20:05.769782 run patchelf(pid=5063): Terminated: ok {rc=0} 16:20:05.895415 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5060): Process ended prematurely: osmo-stp_10.42.42.5(pid=5060) [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5060)] [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 16:20:05.904469 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:20:05.931721 run osmo-hlr_10.42.42.2(pid=5057): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5057)] 16:20:05.979865 run osmo-hlr_10.42.42.2(pid=5057): stdout: | (launched: 2022-12-13_16:20:02.677584) 16:20:06.029965 run osmo-hlr_10.42.42.2(pid=5057): stderr: | [0;m[1;31m20221213162002856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162002856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162002856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162002856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162002856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162002856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162002867 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162002876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162002876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162002876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:06.080633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5056): Terminating (SIGTERM) 16:20:06.121497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5059): Terminating (SIGTERM) 16:20:06.162279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5062): Terminating (SIGTERM) 16:20:06.203335 --- ParallelTerminationStrategy: PID 5056 died... 16:20:06.223030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5056): Terminated: ok {rc=0} 16:20:06.268197 --- ParallelTerminationStrategy: PID 5059 died... 16:20:06.287471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5059): Terminated: ok {rc=0} 16:20:06.332379 --- ParallelTerminationStrategy: PID 5062 died... 16:20:06.351713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5062): Terminated: ok {rc=0} 16:20:06.437239 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:20:07.746032 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:20:07.753316 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:20:07.788192 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:20:07.828423 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:20:07.919099 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:20:07.952615 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:20:07.993054 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:20:08.589996 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:20:08.644602 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:08.656390 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:20:08.729389 tst cs_paging_gprs_active.py: using LAC 34795 16:20:08.860863 tst cs_paging_gprs_active.py: using RAC 115 16:20:08.992097 tst cs_paging_gprs_active.py: using CellId 34795 16:20:09.128456 tst cs_paging_gprs_active.py: using BVCI 34796 16:20:09.252151 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:09.263661 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:09.274983 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:09.286333 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:09.297882 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:09.309518 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:09.321336 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:09.332750 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:09.344608 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:20:09.464657 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:20:09.587679 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:20:09.816815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:10.157036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5070): Launched 16:20:10.453323 run iperf3-srv_10.42.42.10(pid=5071): Launched 16:20:10.580303 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:20:10.809348 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:11.149602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5072): Launched 16:20:11.443891 run iperf3-srv_10.42.42.10(pid=5073): Launched 16:20:11.570617 tst cs_paging_gprs_active.py:38: start network... 16:20:11.797669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:12.320567 run create_hlr_db(pid=5074): Launched 16:20:12.451276 bus /gobi_6: Setting Powered False 16:20:13.516895 run create_hlr_db(pid=5074): Terminated: ok {rc=0} 16:20:13.986189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5076): Launched 16:20:14.324468 run osmo-hlr_10.42.42.2(pid=5077): Launched 16:20:14.454627 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:15.039439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5079): Launched 16:20:15.379710 run osmo-stp_10.42.42.5(pid=5080): Launched 16:20:15.510149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:16.113248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5082): Launched 16:20:16.251141 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:16.543075 run patchelf(pid=5083): Launched 16:20:16.770486 run osmo-stp_10.42.42.5(pid=5080): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5080)] 16:20:16.909844 run osmo-stp_10.42.42.5(pid=5080): stdout: | (launched: 2022-12-13_16:20:15.317098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:17.050058 run osmo-stp_10.42.42.5(pid=5080): stderr: | [0;m[38;5;43m20221213162015512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162015512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162015513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162015513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162015515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162015515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162015516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:17.190219 run osmo-stp_10.42.42.5(pid=5080): stdout: | (launched: 2022-12-13_16:20:15.317098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:17.323087 run osmo-stp_10.42.42.5(pid=5080): stderr: | [0;m[38;5;43m20221213162015512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162015512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162015513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162015513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162015515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162015515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162015516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:17.477746 run patchelf(pid=5083): Terminating (SIGINT) 16:20:17.656921 run patchelf(pid=5083): Terminated: ok {rc=0} 16:20:17.786263 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5080): Process ended prematurely: osmo-stp_10.42.42.5(pid=5080) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5080)] [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:20:17.796165 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 16:20:17.824142 run osmo-hlr_10.42.42.2(pid=5077): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5077)] 16:20:17.873700 run osmo-hlr_10.42.42.2(pid=5077): stdout: | (launched: 2022-12-13_16:20:14.262108) 16:20:17.924428 run osmo-hlr_10.42.42.2(pid=5077): stderr: | [0;m[1;31m20221213162014463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162014463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162014463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162014463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162014463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162014463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162014475 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162014484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162014485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162014485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:17.975602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5070): Terminating (SIGTERM) 16:20:18.016622 run iperf3-srv_10.42.42.10(pid=5071): Terminating (SIGTERM) 16:20:18.057622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5072): Terminating (SIGTERM) 16:20:18.098818 run iperf3-srv_10.42.42.10(pid=5073): Terminating (SIGTERM) 16:20:18.139651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5076): Terminating (SIGTERM) 16:20:18.180675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5079): Terminating (SIGTERM) 16:20:18.221502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5082): Terminating (SIGTERM) 16:20:18.262742 --- ParallelTerminationStrategy: PID 5070 died... 16:20:18.282416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5070): Terminated: ok {rc=0} 16:20:18.327589 --- ParallelTerminationStrategy: PID 5071 died... 16:20:18.347188 run iperf3-srv_10.42.42.10(pid=5071): Terminated {rc=256} 16:20:18.392364 --- ParallelTerminationStrategy: PID 5072 died... 16:20:18.412048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5072): Terminated: ok {rc=0} 16:20:18.457338 --- ParallelTerminationStrategy: PID 5073 died... 16:20:18.476676 run iperf3-srv_10.42.42.10(pid=5073): Terminated {rc=256} 16:20:18.522176 --- ParallelTerminationStrategy: PID 5076 died... 16:20:18.541994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5076): Terminated: ok {rc=0} 16:20:18.587195 --- ParallelTerminationStrategy: PID 5079 died... 16:20:18.606895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5079): Terminated: ok {rc=0} 16:20:18.652233 --- ParallelTerminationStrategy: PID 5082 died... 16:20:18.672107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5082): Terminated: ok {rc=0} 16:20:18.760417 bus /gobi_0: Setting Powered False 16:20:19.862764 bus /gobi_0: Setting Powered False 16:20:20.979587 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:20:22.129175 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:22.141123 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:20:22.211550 tst iperf3.py: using LAC 34796 16:20:22.334699 tst iperf3.py: using RAC 116 16:20:22.459361 tst iperf3.py: using CellId 34796 16:20:22.583942 tst iperf3.py: using BVCI 34797 16:20:22.697979 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:22.708919 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:22.719728 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:22.730597 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:22.741294 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:22.752520 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:22.763944 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:22.774899 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:22.786262 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:20:22.903667 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:20:23.115901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:23.433875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5084): Launched 16:20:23.711377 run iperf3-srv_10.42.42.10(pid=5085): Launched 16:20:23.831918 tst iperf3.py:8: start network... 16:20:24.042880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:24.531326 run create_hlr_db(pid=5086): Launched 16:20:24.662196 bus /gobi_6: Setting Powered False 16:20:25.724498 run create_hlr_db(pid=5086): Terminated: ok {rc=0} 16:20:26.182505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5088): Launched 16:20:26.519994 run osmo-hlr_10.42.42.2(pid=5089): Launched 16:20:26.652299 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:27.330694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5091): Launched 16:20:27.661601 run osmo-stp_10.42.42.5(pid=5092): Launched 16:20:27.788853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:28.358805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5094): Launched 16:20:28.485423 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:28.765858 run patchelf(pid=5095): Launched 16:20:28.949449 run osmo-stp_10.42.42.5(pid=5092): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5092)] 16:20:29.088334 run osmo-stp_10.42.42.5(pid=5092): stdout: | (launched: 2022-12-13_16:20:27.600115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:29.229326 run osmo-stp_10.42.42.5(pid=5092): stderr: | [0;m[38;5;43m20221213162027794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162027794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162027794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162027795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162027795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162027795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162027795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:29.371067 run osmo-stp_10.42.42.5(pid=5092): stdout: | (launched: 2022-12-13_16:20:27.600115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:29.505512 run osmo-stp_10.42.42.5(pid=5092): stderr: | [0;m[38;5;43m20221213162027794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162027794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162027794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162027795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162027795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162027795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162027795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:29.665431 run patchelf(pid=5095): Terminating (SIGINT) 16:20:29.849896 run patchelf(pid=5095): Terminated: ok {rc=0} 16:20:29.983367 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5092): Process ended prematurely: osmo-stp_10.42.42.5(pid=5092) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5092)] [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 16:20:29.993751 tst iperf3.py:8: Test FAILED (7.9 sec) 16:20:30.022571 run osmo-hlr_10.42.42.2(pid=5089): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5089)] 16:20:30.073396 run osmo-hlr_10.42.42.2(pid=5089): stdout: | (launched: 2022-12-13_16:20:26.457799) 16:20:30.126010 run osmo-hlr_10.42.42.2(pid=5089): stderr: | [0;m[1;31m20221213162026659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162026659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162026659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162026659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162026659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162026659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162026714 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162026724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162026724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162026724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:30.178479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5084): Terminating (SIGTERM) 16:20:30.221000 run iperf3-srv_10.42.42.10(pid=5085): Terminating (SIGTERM) 16:20:30.263405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5088): Terminating (SIGTERM) 16:20:30.306222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5091): Terminating (SIGTERM) 16:20:30.348550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5094): Terminating (SIGTERM) 16:20:30.391968 --- ParallelTerminationStrategy: PID 5084 died... 16:20:30.412405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5084): Terminated: ok {rc=0} 16:20:30.458907 --- ParallelTerminationStrategy: PID 5085 died... 16:20:30.478749 run iperf3-srv_10.42.42.10(pid=5085): Terminated {rc=256} 16:20:30.525115 --- ParallelTerminationStrategy: PID 5088 died... 16:20:30.545260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5088): Terminated: ok {rc=0} 16:20:30.591545 --- ParallelTerminationStrategy: PID 5091 died... 16:20:30.611330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5091): Terminated: ok {rc=0} 16:20:30.657819 --- ParallelTerminationStrategy: PID 5094 died... 16:20:30.677707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5094): Terminated: ok {rc=0} 16:20:30.766438 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:20:31.929638 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:31.942399 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:20:32.014405 tst iperf3m4.py: using LAC 34797 16:20:32.146283 tst iperf3m4.py: using RAC 117 16:20:32.277651 tst iperf3m4.py: using CellId 34797 16:20:32.406569 tst iperf3m4.py: using BVCI 34798 16:20:32.526257 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:32.537756 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:32.548931 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:32.560325 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:32.571890 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:32.583463 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:32.595130 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:32.606668 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:32.618333 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:20:32.736743 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:20:32.862122 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:20:32.986075 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:20:33.106665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:20:33.313336 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:33.625186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5096): Launched 16:20:33.895999 run iperf3-srv_10.42.42.10(pid=5097): Launched 16:20:34.012414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:20:34.218856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:34.530179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5098): Launched 16:20:34.800805 run iperf3-srv_10.42.42.10(pid=5099): Launched 16:20:34.917681 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:20:35.123591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:35.434923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5100): Launched 16:20:35.704601 run iperf3-srv_10.42.42.10(pid=5101): Launched 16:20:35.820151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:20:36.026116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:36.336686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5102): Launched 16:20:36.606130 run iperf3-srv_10.42.42.10(pid=5103): Launched 16:20:36.721716 tst iperf3m4.py:8: start network... 16:20:36.928160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:37.408755 run create_hlr_db(pid=5104): Launched 16:20:37.538221 bus /gobi_6: Setting Powered False 16:20:38.602641 run create_hlr_db(pid=5104): Terminated: ok {rc=0} 16:20:39.060637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5106): Launched 16:20:39.394115 run osmo-hlr_10.42.42.2(pid=5107): Launched 16:20:39.521153 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:40.090504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5109): Launched 16:20:40.422784 run osmo-stp_10.42.42.5(pid=5110): Launched 16:20:40.551329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:41.121360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5112): Launched 16:20:41.249348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:41.529235 run patchelf(pid=5113): Launched 16:20:41.715617 run osmo-stp_10.42.42.5(pid=5110): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5110)] 16:20:41.855589 run osmo-stp_10.42.42.5(pid=5110): stdout: | (launched: 2022-12-13_16:20:40.361705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:41.999745 run osmo-stp_10.42.42.5(pid=5110): stderr: | [0;m[38;5;43m20221213162040554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162040554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162040555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162040555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162040555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162040555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162040555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:42.141333 run osmo-stp_10.42.42.5(pid=5110): stdout: | (launched: 2022-12-13_16:20:40.361705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:42.276588 run osmo-stp_10.42.42.5(pid=5110): stderr: | [0;m[38;5;43m20221213162040554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162040554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162040555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162040555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162040555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162040555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162040555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:42.436772 run patchelf(pid=5113): Terminating (SIGINT) 16:20:42.622327 run patchelf(pid=5113): Terminated: ok {rc=0} 16:20:42.756668 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5110): Process ended prematurely: osmo-stp_10.42.42.5(pid=5110) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5110)] [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:20:42.767358 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:20:42.796775 run osmo-hlr_10.42.42.2(pid=5107): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5107)] 16:20:42.848172 run osmo-hlr_10.42.42.2(pid=5107): stdout: | (launched: 2022-12-13_16:20:39.332298) 16:20:42.901055 run osmo-hlr_10.42.42.2(pid=5107): stderr: | [0;m[1;31m20221213162039533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162039533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162039533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162039533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162039533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162039533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162039546 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162039554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162039554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162039554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:42.954823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5096): Terminating (SIGTERM) 16:20:42.997648 run iperf3-srv_10.42.42.10(pid=5097): Terminating (SIGTERM) 16:20:43.040464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5098): Terminating (SIGTERM) 16:20:43.083348 run iperf3-srv_10.42.42.10(pid=5099): Terminating (SIGTERM) 16:20:43.126515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5100): Terminating (SIGTERM) 16:20:43.168869 run iperf3-srv_10.42.42.10(pid=5101): Terminating (SIGTERM) 16:20:43.211563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5102): Terminating (SIGTERM) 16:20:43.253939 run iperf3-srv_10.42.42.10(pid=5103): Terminating (SIGTERM) 16:20:43.296436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5106): Terminating (SIGTERM) 16:20:43.338829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5109): Terminating (SIGTERM) 16:20:43.381654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5112): Terminating (SIGTERM) 16:20:43.424143 --- ParallelTerminationStrategy: PID 5096 died... 16:20:43.444677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5096): Terminated: ok {rc=0} 16:20:43.491380 --- ParallelTerminationStrategy: PID 5097 died... 16:20:43.511103 run iperf3-srv_10.42.42.10(pid=5097): Terminated {rc=256} 16:20:43.557628 --- ParallelTerminationStrategy: PID 5098 died... 16:20:43.577509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5098): Terminated: ok {rc=0} 16:20:43.623821 --- ParallelTerminationStrategy: PID 5099 died... 16:20:43.643854 run iperf3-srv_10.42.42.10(pid=5099): Terminated {rc=256} 16:20:43.690717 --- ParallelTerminationStrategy: PID 5100 died... 16:20:43.710517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5100): Terminated: ok {rc=0} 16:20:43.757048 --- ParallelTerminationStrategy: PID 5101 died... 16:20:43.776886 run iperf3-srv_10.42.42.10(pid=5101): Terminated {rc=256} 16:20:43.823367 --- ParallelTerminationStrategy: PID 5102 died... 16:20:43.843419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5102): Terminated: ok {rc=0} 16:20:43.889909 --- ParallelTerminationStrategy: PID 5103 died... 16:20:43.909839 run iperf3-srv_10.42.42.10(pid=5103): Terminated {rc=256} 16:20:43.956415 --- ParallelTerminationStrategy: PID 5106 died... 16:20:43.976368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5106): Terminated: ok {rc=0} 16:20:44.022835 --- ParallelTerminationStrategy: PID 5109 died... 16:20:44.042845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5109): Terminated: ok {rc=0} 16:20:44.089337 --- ParallelTerminationStrategy: PID 5112 died... 16:20:44.109329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5112): Terminated: ok {rc=0} 16:20:44.198754 bus /gobi_4: Setting Powered False 16:20:45.297189 bus /gobi_4: Setting Powered False 16:20:46.418222 bus /gobi_1: Setting Powered False 16:20:47.528371 bus /gobi_1: Setting Powered False 16:20:48.646292 bus /gobi_0: Setting Powered False 16:20:49.744740 bus /gobi_0: Setting Powered False 16:20:50.862920 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:20:51.967482 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:51.979951 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:20:52.053455 tst ping.py: using LAC 34798 16:20:52.182506 tst ping.py: using RAC 118 16:20:52.309371 tst ping.py: using CellId 34798 16:20:52.437585 tst ping.py: using BVCI 34799 16:20:52.555463 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:52.566972 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:52.578299 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:52.589759 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:52.601276 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:52.613219 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:52.624831 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:20:52.636407 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:20:52.756521 tst ping.py:19: start network... 16:20:52.975057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:53.480219 run create_hlr_db(pid=5115): Launched 16:20:53.605876 bus /gobi_6: Setting Powered False 16:20:54.670342 run create_hlr_db(pid=5115): Terminated: ok {rc=0} 16:20:55.124441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5117): Launched 16:20:55.451569 run osmo-hlr_10.42.42.2(pid=5118): Launched 16:20:55.577843 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:56.140021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5120): Launched 16:20:56.468250 run osmo-stp_10.42.42.5(pid=5121): Launched 16:20:56.594770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:57.158287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5123): Launched 16:20:57.283825 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:57.558554 run patchelf(pid=5124): Launched 16:20:57.739340 run osmo-stp_10.42.42.5(pid=5121): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5121)] 16:20:57.876337 run osmo-stp_10.42.42.5(pid=5121): stdout: | (launched: 2022-12-13_16:20:56.407562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:58.016172 run osmo-stp_10.42.42.5(pid=5121): stderr: | [0;m[38;5;43m20221213162056599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162056599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162056600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162056600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162056601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162056601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162056601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:58.155647 run osmo-stp_10.42.42.5(pid=5121): stdout: | (launched: 2022-12-13_16:20:56.407562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:58.288238 run osmo-stp_10.42.42.5(pid=5121): stderr: | [0;m[38;5;43m20221213162056599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162056599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162056600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162056600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162056601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162056601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162056601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:58.445633 run patchelf(pid=5124): Terminating (SIGINT) 16:20:58.627641 run patchelf(pid=5124): Terminated: ok {rc=0} 16:20:58.759077 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5121): Process ended prematurely: osmo-stp_10.42.42.5(pid=5121) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5121)] [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 16:20:58.768751 tst ping.py:22: Test FAILED (6.8 sec) 16:20:58.797224 run osmo-hlr_10.42.42.2(pid=5118): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5118)] 16:20:58.848075 run osmo-hlr_10.42.42.2(pid=5118): stdout: | (launched: 2022-12-13_16:20:55.391235) 16:20:58.900229 run osmo-hlr_10.42.42.2(pid=5118): stderr: | [0;m[1;31m20221213162055590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162055590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162055590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162055590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162055590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162055590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162055602 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162055610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162055611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162055611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:58.953788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5117): Terminating (SIGTERM) 16:20:58.996342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5120): Terminating (SIGTERM) 16:20:59.039382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5123): Terminating (SIGTERM) 16:20:59.082908 --- ParallelTerminationStrategy: PID 5117 died... 16:20:59.103462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5117): Terminated: ok {rc=0} 16:20:59.150151 --- ParallelTerminationStrategy: PID 5120 died... 16:20:59.170397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5120): Terminated: ok {rc=0} 16:20:59.217138 --- ParallelTerminationStrategy: PID 5123 died... 16:20:59.237274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5123): Terminated: ok {rc=0} 16:20:59.326701 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:21:00.411673 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:21:00.423819 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:21:00.498698 tst ping_idle_ping.py: using LAC 34799 16:21:00.622210 tst ping_idle_ping.py: using RAC 119 16:21:00.745494 tst ping_idle_ping.py: using CellId 34799 16:21:00.876053 tst ping_idle_ping.py: using BVCI 34800 16:21:01.026100 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:21:01.038763 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:21:01.051115 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:21:01.063124 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:21:01.076497 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:21:01.090068 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:21:01.103532 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:21:01.116997 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:21:01.233835 tst ping_idle_ping.py:24: start network... 16:21:01.437533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:01.922436 run create_hlr_db(pid=5125): Launched 16:21:02.074619 bus /gobi_6: Setting Powered False 16:21:03.134070 run create_hlr_db(pid=5125): Terminated: ok {rc=0} 16:21:03.546704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5127): Launched 16:21:03.843248 run osmo-hlr_10.42.42.2(pid=5128): Launched 16:21:03.955656 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:04.460795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5130): Launched 16:21:04.758421 run osmo-stp_10.42.42.5(pid=5131): Launched 16:21:04.871650 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:05.382338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5133): Launched 16:21:05.495882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:05.745702 run patchelf(pid=5134): Launched 16:21:05.909578 run osmo-stp_10.42.42.5(pid=5131): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5131)] 16:21:06.034571 run osmo-stp_10.42.42.5(pid=5131): stdout: | (launched: 2022-12-13_16:21:04.702831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:06.161492 run osmo-stp_10.42.42.5(pid=5131): stderr: | [0;m[38;5;43m20221213162104869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162104869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162104869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162104870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162104870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162104870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162104870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:06.287993 run osmo-stp_10.42.42.5(pid=5131): stdout: | (launched: 2022-12-13_16:21:04.702831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:06.408438 run osmo-stp_10.42.42.5(pid=5131): stderr: | [0;m[38;5;43m20221213162104869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162104869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162104869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162104870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162104870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162104870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162104870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:06.551443 run patchelf(pid=5134): Terminating (SIGINT) 16:21:06.717248 run patchelf(pid=5134): Terminated: ok {rc=0} 16:21:06.836702 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5131): Process ended prematurely: osmo-stp_10.42.42.5(pid=5131) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5131)] [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:21:06.845806 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 16:21:06.872240 run osmo-hlr_10.42.42.2(pid=5128): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5128)] 16:21:06.919622 run osmo-hlr_10.42.42.2(pid=5128): stdout: | (launched: 2022-12-13_16:21:03.788038) 16:21:06.968417 run osmo-hlr_10.42.42.2(pid=5128): stderr: | [0;m[1;31m20221213162103961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162103961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162103961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162103961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162103961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162103961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162103973 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162103983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162103983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162103983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:07.017576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5127): Terminating (SIGTERM) 16:21:07.056774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5130): Terminating (SIGTERM) 16:21:07.095866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5133): Terminating (SIGTERM) 16:21:07.135809 --- ParallelTerminationStrategy: PID 5127 died... 16:21:07.154647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5127): Terminated: ok {rc=0} 16:21:07.197969 --- ParallelTerminationStrategy: PID 5130 died... 16:21:07.216188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5130): Terminated: ok {rc=0} 16:21:07.259289 --- ParallelTerminationStrategy: PID 5133 died... 16:21:07.277630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5133): Terminated: ok {rc=0} 16:21:07.360109 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:21:08.661546 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:08.667511 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:21:08.699640 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:21:08.738190 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:21:08.824629 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:21:08.856768 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:21:08.895022 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:21:09.489930 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:21:09.545990 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:09.557524 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:21:09.630080 tst cs_paging_gprs_active.py: using LAC 34800 16:21:09.758211 tst cs_paging_gprs_active.py: using RAC 120 16:21:09.885428 tst cs_paging_gprs_active.py: using CellId 34800 16:21:10.011717 tst cs_paging_gprs_active.py: using BVCI 34801 16:21:10.128807 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:10.140179 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:10.151431 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:10.162657 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:10.174203 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:10.185742 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:10.197376 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:10.208919 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:10.220582 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:21:10.338219 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:21:10.462495 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:21:10.680371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:11.005213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5138): Launched 16:21:11.288356 run iperf3-srv_10.42.42.10(pid=5139): Launched 16:21:11.410215 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:21:11.627685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:11.953626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5140): Launched 16:21:12.236207 run iperf3-srv_10.42.42.10(pid=5141): Launched 16:21:12.357849 tst cs_paging_gprs_active.py:38: start network... 16:21:12.575396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:13.076762 run create_hlr_db(pid=5142): Launched 16:21:13.199650 bus /gobi_6: Setting Powered False 16:21:14.263035 run create_hlr_db(pid=5142): Terminated: ok {rc=0} 16:21:14.694345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5144): Launched 16:21:14.997621 run osmo-hlr_10.42.42.2(pid=5145): Launched 16:21:15.112573 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:15.635642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5147): Launched 16:21:15.957779 run osmo-stp_10.42.42.5(pid=5148): Launched 16:21:16.136591 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:16.902802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5150): Launched 16:21:17.052927 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:17.373601 run patchelf(pid=5151): Launched 16:21:17.545376 run osmo-stp_10.42.42.5(pid=5148): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5148)] 16:21:17.672492 run osmo-stp_10.42.42.5(pid=5148): stdout: | (launched: 2022-12-13_16:21:15.884542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:17.801143 run osmo-stp_10.42.42.5(pid=5148): stderr: | [0;m[38;5;43m20221213162116252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162116252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162116252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162116258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162116259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162116259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162116259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:17.929438 run osmo-stp_10.42.42.5(pid=5148): stdout: | (launched: 2022-12-13_16:21:15.884542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:18.052005 run osmo-stp_10.42.42.5(pid=5148): stderr: | [0;m[38;5;43m20221213162116252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162116252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162116252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162116258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162116259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162116259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162116259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:18.197408 run patchelf(pid=5151): Terminating (SIGINT) 16:21:18.366347 run patchelf(pid=5151): Terminated: ok {rc=0} 16:21:18.488410 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5148): Process ended prematurely: osmo-stp_10.42.42.5(pid=5148) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5148)] [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:21:18.497930 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:21:18.524458 run osmo-hlr_10.42.42.2(pid=5145): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5145)] 16:21:18.571302 run osmo-hlr_10.42.42.2(pid=5145): stdout: | (launched: 2022-12-13_16:21:14.941661) 16:21:18.619709 run osmo-hlr_10.42.42.2(pid=5145): stderr: | [0;m[1;31m20221213162115114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162115114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162115114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162115114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162115114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162115114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162115126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162115135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162115135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162115135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:18.668833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5138): Terminating (SIGTERM) 16:21:18.708019 run iperf3-srv_10.42.42.10(pid=5139): Terminating (SIGTERM) 16:21:18.746997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5140): Terminating (SIGTERM) 16:21:18.785931 run iperf3-srv_10.42.42.10(pid=5141): Terminating (SIGTERM) 16:21:18.824621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5144): Terminating (SIGTERM) 16:21:18.863891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5147): Terminating (SIGTERM) 16:21:18.902942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5150): Terminating (SIGTERM) 16:21:18.942287 --- ParallelTerminationStrategy: PID 5138 died... 16:21:18.961082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5138): Terminated: ok {rc=0} 16:21:19.004228 --- ParallelTerminationStrategy: PID 5139 died... 16:21:19.022583 run iperf3-srv_10.42.42.10(pid=5139): Terminated {rc=256} 16:21:19.065522 --- ParallelTerminationStrategy: PID 5140 died... 16:21:19.083738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5140): Terminated: ok {rc=0} 16:21:19.126899 --- ParallelTerminationStrategy: PID 5141 died... 16:21:19.145201 run iperf3-srv_10.42.42.10(pid=5141): Terminated {rc=256} 16:21:19.188031 --- ParallelTerminationStrategy: PID 5144 died... 16:21:19.206529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5144): Terminated: ok {rc=0} 16:21:19.250090 --- ParallelTerminationStrategy: PID 5147 died... 16:21:19.268259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5147): Terminated: ok {rc=0} 16:21:19.311310 --- ParallelTerminationStrategy: PID 5150 died... 16:21:19.329630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5150): Terminated: ok {rc=0} 16:21:19.414920 bus /gobi_0: Setting Powered False 16:21:20.513368 bus /gobi_0: Setting Powered False 16:21:21.624579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:21:22.772887 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:22.785412 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:21:22.859136 tst iperf3.py: using LAC 34801 16:21:22.987225 tst iperf3.py: using RAC 121 16:21:23.114616 tst iperf3.py: using CellId 34801 16:21:23.242456 tst iperf3.py: using BVCI 34802 16:21:23.360020 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:23.371405 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:23.382638 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:23.393978 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:23.405414 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:23.416799 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:23.428434 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:23.439848 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:23.451469 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:21:23.571825 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:21:23.787682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:24.110510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5152): Launched 16:21:24.391106 run iperf3-srv_10.42.42.10(pid=5153): Launched 16:21:24.512003 tst iperf3.py:8: start network... 16:21:24.728097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:25.225715 run create_hlr_db(pid=5154): Launched 16:21:25.348247 bus /gobi_6: Setting Powered False 16:21:26.411075 run create_hlr_db(pid=5154): Terminated: ok {rc=0} 16:21:26.857696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5156): Launched 16:21:27.180456 run osmo-hlr_10.42.42.2(pid=5157): Launched 16:21:27.303198 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:27.856399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5159): Launched 16:21:28.179964 run osmo-stp_10.42.42.5(pid=5160): Launched 16:21:28.303263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:28.859228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5162): Launched 16:21:28.983068 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:29.255565 run patchelf(pid=5163): Launched 16:21:29.435096 run osmo-stp_10.42.42.5(pid=5160): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5160)] 16:21:29.570724 run osmo-stp_10.42.42.5(pid=5160): stdout: | (launched: 2022-12-13_16:21:28.120536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:29.708576 run osmo-stp_10.42.42.5(pid=5160): stderr: | [0;m[38;5;43m20221213162128309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162128309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162128309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162128310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162128310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162128310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162128310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:29.846754 run osmo-stp_10.42.42.5(pid=5160): stdout: | (launched: 2022-12-13_16:21:28.120536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:29.978794 run osmo-stp_10.42.42.5(pid=5160): stderr: | [0;m[38;5;43m20221213162128309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162128309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162128309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162128310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162128310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162128310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162128310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:30.135276 run patchelf(pid=5163): Terminating (SIGINT) 16:21:30.316230 run patchelf(pid=5163): Terminated: ok {rc=0} 16:21:30.447047 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5160): Process ended prematurely: osmo-stp_10.42.42.5(pid=5160) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5160)] [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 16:21:30.457290 tst iperf3.py:8: Test FAILED (7.7 sec) 16:21:30.485713 run osmo-hlr_10.42.42.2(pid=5157): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5157)] 16:21:30.536112 run osmo-hlr_10.42.42.2(pid=5157): stdout: | (launched: 2022-12-13_16:21:27.121156) 16:21:30.587944 run osmo-hlr_10.42.42.2(pid=5157): stderr: | [0;m[1;31m20221213162127318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162127318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162127318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162127318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162127318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162127318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162127330 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162127338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162127338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162127339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:30.640135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5152): Terminating (SIGTERM) 16:21:30.682294 run iperf3-srv_10.42.42.10(pid=5153): Terminating (SIGTERM) 16:21:30.724257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5156): Terminating (SIGTERM) 16:21:30.766662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5159): Terminating (SIGTERM) 16:21:30.809319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5162): Terminating (SIGTERM) 16:21:30.863894 --- ParallelTerminationStrategy: PID 5152 died... 16:21:30.893211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5152): Terminated: ok {rc=0} 16:21:30.938334 --- ParallelTerminationStrategy: PID 5153 died... 16:21:30.957488 run iperf3-srv_10.42.42.10(pid=5153): Terminated {rc=256} 16:21:31.002035 --- ParallelTerminationStrategy: PID 5156 died... 16:21:31.021184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5156): Terminated: ok {rc=0} 16:21:31.071496 --- ParallelTerminationStrategy: PID 5159 died... 16:21:31.090698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5159): Terminated: ok {rc=0} 16:21:31.135114 --- ParallelTerminationStrategy: PID 5162 died... 16:21:31.154449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5162): Terminated: ok {rc=0} 16:21:31.244730 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:21:32.388329 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:32.399951 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:21:32.470576 tst iperf3m4.py: using LAC 34802 16:21:32.589833 tst iperf3m4.py: using RAC 122 16:21:32.709457 tst iperf3m4.py: using CellId 34802 16:21:32.827792 tst iperf3m4.py: using BVCI 34803 16:21:32.937024 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:32.948112 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:32.959076 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:32.970139 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:32.981129 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:32.992161 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:33.003278 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:33.014310 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:33.025690 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:21:33.142925 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:21:33.265157 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:21:33.384016 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:21:33.504476 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:21:33.720261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:34.042647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5164): Launched 16:21:34.322628 run iperf3-srv_10.42.42.10(pid=5165): Launched 16:21:34.443480 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:21:34.659442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:34.982857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5166): Launched 16:21:35.263126 run iperf3-srv_10.42.42.10(pid=5167): Launched 16:21:35.384424 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:21:35.600281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:35.923087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5168): Launched 16:21:36.203507 run iperf3-srv_10.42.42.10(pid=5169): Launched 16:21:36.324361 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:21:36.539911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:36.863022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5170): Launched 16:21:37.143445 run iperf3-srv_10.42.42.10(pid=5171): Launched 16:21:37.264383 tst iperf3m4.py:8: start network... 16:21:37.480504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:37.976773 run create_hlr_db(pid=5172): Launched 16:21:38.099383 bus /gobi_6: Setting Powered False 16:21:39.162869 run create_hlr_db(pid=5172): Terminated: ok {rc=0} 16:21:39.609546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5174): Launched 16:21:39.930764 run osmo-hlr_10.42.42.2(pid=5175): Launched 16:21:40.056130 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:40.617704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5177): Launched 16:21:40.944665 run osmo-stp_10.42.42.5(pid=5178): Launched 16:21:41.071052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:41.638405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5180): Launched 16:21:41.765429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:42.044127 run patchelf(pid=5181): Launched 16:21:42.227349 run osmo-stp_10.42.42.5(pid=5178): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5178)] 16:21:42.366884 run osmo-stp_10.42.42.5(pid=5178): stdout: | (launched: 2022-12-13_16:21:40.884919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:42.508479 run osmo-stp_10.42.42.5(pid=5178): stderr: | [0;m[38;5;43m20221213162141073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162141073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162141073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162141074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162141074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162141074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162141074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:42.650302 run osmo-stp_10.42.42.5(pid=5178): stdout: | (launched: 2022-12-13_16:21:40.884919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:42.785164 run osmo-stp_10.42.42.5(pid=5178): stderr: | [0;m[38;5;43m20221213162141073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162141073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162141073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162141074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162141074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162141074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162141074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:42.945086 run patchelf(pid=5181): Terminating (SIGINT) 16:21:43.130052 run patchelf(pid=5181): Terminated: ok {rc=0} 16:21:43.263263 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5178): Process ended prematurely: osmo-stp_10.42.42.5(pid=5178) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5178)] [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:21:43.273773 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:21:43.302943 run osmo-hlr_10.42.42.2(pid=5175): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5175)] 16:21:43.354339 run osmo-hlr_10.42.42.2(pid=5175): stdout: | (launched: 2022-12-13_16:21:39.871947) 16:21:43.407606 run osmo-hlr_10.42.42.2(pid=5175): stderr: | [0;m[1;31m20221213162140065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162140066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162140066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162140066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162140066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162140066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162140078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162140087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162140087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162140087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:43.461805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5164): Terminating (SIGTERM) 16:21:43.504211 run iperf3-srv_10.42.42.10(pid=5165): Terminating (SIGTERM) 16:21:43.547501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5166): Terminating (SIGTERM) 16:21:43.590701 run iperf3-srv_10.42.42.10(pid=5167): Terminating (SIGTERM) 16:21:43.633700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5168): Terminating (SIGTERM) 16:21:43.676692 run iperf3-srv_10.42.42.10(pid=5169): Terminating (SIGTERM) 16:21:43.719793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5170): Terminating (SIGTERM) 16:21:43.763063 run iperf3-srv_10.42.42.10(pid=5171): Terminating (SIGTERM) 16:21:43.806267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5174): Terminating (SIGTERM) 16:21:43.849051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5177): Terminating (SIGTERM) 16:21:43.891813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5180): Terminating (SIGTERM) 16:21:43.934793 --- ParallelTerminationStrategy: PID 5164 died... 16:21:43.956083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5164): Terminated: ok {rc=0} 16:21:44.003672 --- ParallelTerminationStrategy: PID 5165 died... 16:21:44.024018 run iperf3-srv_10.42.42.10(pid=5165): Terminated {rc=256} 16:21:44.071074 --- ParallelTerminationStrategy: PID 5166 died... 16:21:44.091276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5166): Terminated: ok {rc=0} 16:21:44.138508 --- ParallelTerminationStrategy: PID 5167 died... 16:21:44.158881 run iperf3-srv_10.42.42.10(pid=5167): Terminated {rc=256} 16:21:44.205874 --- ParallelTerminationStrategy: PID 5168 died... 16:21:44.226116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5168): Terminated: ok {rc=0} 16:21:44.273339 --- ParallelTerminationStrategy: PID 5169 died... 16:21:44.293561 run iperf3-srv_10.42.42.10(pid=5169): Terminated {rc=256} 16:21:44.340671 --- ParallelTerminationStrategy: PID 5170 died... 16:21:44.361600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5170): Terminated: ok {rc=0} 16:21:44.409035 --- ParallelTerminationStrategy: PID 5171 died... 16:21:44.429377 run iperf3-srv_10.42.42.10(pid=5171): Terminated {rc=256} 16:21:44.476558 --- ParallelTerminationStrategy: PID 5174 died... 16:21:44.497510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5174): Terminated: ok {rc=0} 16:21:44.544590 --- ParallelTerminationStrategy: PID 5177 died... 16:21:44.565189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5177): Terminated: ok {rc=0} 16:21:44.612403 --- ParallelTerminationStrategy: PID 5180 died... 16:21:44.633009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5180): Terminated: ok {rc=0} 16:21:44.722398 bus /gobi_4: Setting Powered False 16:21:45.822161 bus /gobi_4: Setting Powered False 16:21:46.967931 bus /gobi_1: Setting Powered False 16:21:48.066730 bus /gobi_1: Setting Powered False 16:21:49.181217 bus /gobi_0: Setting Powered False 16:21:50.282031 bus /gobi_0: Setting Powered False 16:21:51.400235 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:21:52.501919 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:52.513860 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:21:52.583703 tst ping.py: using LAC 34803 16:21:52.700426 tst ping.py: using RAC 123 16:21:52.817482 tst ping.py: using CellId 34803 16:21:52.936159 tst ping.py: using BVCI 34804 16:21:53.045619 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:53.056487 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:53.067331 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:53.078197 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:53.088851 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:53.099802 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:53.111226 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:21:53.122230 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:21:53.236414 tst ping.py:19: start network... 16:21:53.437176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:53.907052 run create_hlr_db(pid=5182): Launched 16:21:54.030865 bus /gobi_6: Setting Powered False 16:21:55.091151 run create_hlr_db(pid=5182): Terminated: ok {rc=0} 16:21:55.516477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5184): Launched 16:21:55.821189 run osmo-hlr_10.42.42.2(pid=5185): Launched 16:21:55.937348 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:56.456731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5187): Launched 16:21:56.760164 run osmo-stp_10.42.42.5(pid=5188): Launched 16:21:56.874929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:57.395997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5190): Launched 16:21:57.512083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:57.768454 run patchelf(pid=5191): Launched 16:21:57.936919 run osmo-stp_10.42.42.5(pid=5188): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5188)] 16:21:58.065506 run osmo-stp_10.42.42.5(pid=5188): stdout: | (launched: 2022-12-13_16:21:56.704136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:58.195999 run osmo-stp_10.42.42.5(pid=5188): stderr: | [0;m[38;5;43m20221213162156873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162156873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162156873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162156874 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162156874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162156874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162156874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:58.326572 run osmo-stp_10.42.42.5(pid=5188): stdout: | (launched: 2022-12-13_16:21:56.704136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:58.450508 run osmo-stp_10.42.42.5(pid=5188): stderr: | [0;m[38;5;43m20221213162156873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162156873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162156873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162156874 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162156874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162156874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162156874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:58.597598 run patchelf(pid=5191): Terminating (SIGINT) 16:21:58.767765 run patchelf(pid=5191): Terminated: ok {rc=0} 16:21:58.890714 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5188): Process ended prematurely: osmo-stp_10.42.42.5(pid=5188) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5188)] [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 16:21:58.899711 tst ping.py:22: Test FAILED (6.4 sec) 16:21:58.926996 run osmo-hlr_10.42.42.2(pid=5185): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5185)] 16:21:58.975912 run osmo-hlr_10.42.42.2(pid=5185): stdout: | (launched: 2022-12-13_16:21:55.765096) 16:21:59.026435 run osmo-hlr_10.42.42.2(pid=5185): stderr: | [0;m[1;31m20221213162155939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162155939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162155939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162155939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162155939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162155939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162155951 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162155960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162155961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162155961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:59.077176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5184): Terminating (SIGTERM) 16:21:59.118089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5187): Terminating (SIGTERM) 16:21:59.158850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5190): Terminating (SIGTERM) 16:21:59.199900 --- ParallelTerminationStrategy: PID 5184 died... 16:21:59.219300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5184): Terminated: ok {rc=0} 16:21:59.264493 --- ParallelTerminationStrategy: PID 5187 died... 16:21:59.283945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5187): Terminated: ok {rc=0} 16:21:59.328910 --- ParallelTerminationStrategy: PID 5190 died... 16:21:59.348203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5190): Terminated: ok {rc=0} 16:21:59.436191 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:22:00.526099 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:22:00.538587 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:22:00.619339 tst ping_idle_ping.py: using LAC 34804 16:22:00.746192 tst ping_idle_ping.py: using RAC 124 16:22:00.885185 tst ping_idle_ping.py: using CellId 34804 16:22:01.022706 tst ping_idle_ping.py: using BVCI 34805 16:22:01.194642 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:22:01.206689 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:22:01.218575 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:22:01.230440 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:22:01.242439 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:22:01.254036 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:22:01.267228 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:22:01.278892 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:22:01.398421 tst ping_idle_ping.py:24: start network... 16:22:01.609215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:02.093460 run create_hlr_db(pid=5192): Launched 16:22:02.254318 bus /gobi_6: Setting Powered False 16:22:03.318661 run create_hlr_db(pid=5192): Terminated: ok {rc=0} 16:22:03.754769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5194): Launched 16:22:04.058799 run osmo-hlr_10.42.42.2(pid=5195): Launched 16:22:04.173604 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:04.697891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5197): Launched 16:22:05.002929 run osmo-stp_10.42.42.5(pid=5198): Launched 16:22:05.120146 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:22:05.644927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5200): Launched 16:22:05.761916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:22:06.019751 run patchelf(pid=5201): Launched 16:22:06.189746 run osmo-stp_10.42.42.5(pid=5198): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5198)] 16:22:06.318886 run osmo-stp_10.42.42.5(pid=5198): stdout: | (launched: 2022-12-13_16:22:04.946784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:06.449702 run osmo-stp_10.42.42.5(pid=5198): stderr: | [0;m[38;5;43m20221213162205115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162205115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162205115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162205116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162205116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162205116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162205116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:06.580740 run osmo-stp_10.42.42.5(pid=5198): stdout: | (launched: 2022-12-13_16:22:04.946784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:06.705215 run osmo-stp_10.42.42.5(pid=5198): stderr: | [0;m[38;5;43m20221213162205115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162205115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162205115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162205116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162205116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162205116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162205116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:06.852743 run patchelf(pid=5201): Terminating (SIGINT) 16:22:07.024098 run patchelf(pid=5201): Terminated: ok {rc=0} 16:22:07.147247 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5198): Process ended prematurely: osmo-stp_10.42.42.5(pid=5198) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5198)] [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:22:07.156273 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:22:07.183609 run osmo-hlr_10.42.42.2(pid=5195): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5195)] 16:22:07.232213 run osmo-hlr_10.42.42.2(pid=5195): stdout: | (launched: 2022-12-13_16:22:04.002765) 16:22:07.282535 run osmo-hlr_10.42.42.2(pid=5195): stderr: | [0;m[1;31m20221213162204177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162204177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162204177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162204177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162204177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162204177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162204189 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162204198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162204199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162204199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:07.333385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5194): Terminating (SIGTERM) 16:22:07.373805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5197): Terminating (SIGTERM) 16:22:07.414141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5200): Terminating (SIGTERM) 16:22:07.454821 --- ParallelTerminationStrategy: PID 5194 died... 16:22:07.474525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5194): Terminated: ok {rc=0} 16:22:07.519009 --- ParallelTerminationStrategy: PID 5197 died... 16:22:07.537972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5197): Terminated: ok {rc=0} 16:22:07.582345 --- ParallelTerminationStrategy: PID 5200 died... 16:22:07.601874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5200): Terminated: ok {rc=0} 16:22:07.688280 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:22:08.998831 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:22:09.007162 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:22:09.041422 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 16:22:09.081628 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 16:22:09.171153 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:22:09.205123 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 16:22:09.245531 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 16:22:09.851021 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 16:22:09.902586 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:09.914110 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:22:09.968197 tst cs_paging_gprs_active.py: using LAC 34805 16:22:10.100009 tst cs_paging_gprs_active.py: using RAC 125 16:22:10.229534 tst cs_paging_gprs_active.py: using CellId 34805 16:22:10.358714 tst cs_paging_gprs_active.py: using BVCI 34806 16:22:10.478925 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:10.490946 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:10.502830 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:10.514715 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:10.527172 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:10.539305 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:10.551571 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:10.563873 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:10.576251 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:22:10.694146 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:22:10.817592 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:22:11.040586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:11.370674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5205): Launched 16:22:11.658624 run iperf3-srv_10.42.42.10(pid=5206): Launched 16:22:11.783243 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:22:12.005944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:12.338013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5207): Launched 16:22:12.626400 run iperf3-srv_10.42.42.10(pid=5208): Launched 16:22:12.752106 tst cs_paging_gprs_active.py:38: start network... 16:22:12.975130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:13.486818 run create_hlr_db(pid=5209): Launched 16:22:13.612203 bus /gobi_6: Setting Powered False 16:22:14.677520 run create_hlr_db(pid=5209): Terminated: ok {rc=0} 16:22:15.117770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5211): Launched 16:22:15.427297 run osmo-hlr_10.42.42.2(pid=5212): Launched 16:22:15.545233 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:16.118871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5214): Launched 16:22:16.477677 run osmo-stp_10.42.42.5(pid=5215): Launched 16:22:16.711143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:22:17.357497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5217): Launched 16:22:17.475609 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:22:17.737050 run patchelf(pid=5218): Launched 16:22:17.909381 run osmo-stp_10.42.42.5(pid=5215): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5215)] 16:22:18.039816 run osmo-stp_10.42.42.5(pid=5215): stdout: | (launched: 2022-12-13_16:22:16.417395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:18.172054 run osmo-stp_10.42.42.5(pid=5215): stderr: | [0;m[38;5;43m20221213162216759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162216759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162216759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162216760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162216760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162216760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162216768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:18.304079 run osmo-stp_10.42.42.5(pid=5215): stdout: | (launched: 2022-12-13_16:22:16.417395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:18.430351 run osmo-stp_10.42.42.5(pid=5215): stderr: | [0;m[38;5;43m20221213162216759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162216759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162216759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162216760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162216760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162216760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162216768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:18.579355 run patchelf(pid=5218): Terminating (SIGINT) 16:22:18.752482 run patchelf(pid=5218): Terminated: ok {rc=0} 16:22:18.877519 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5215): Process ended prematurely: osmo-stp_10.42.42.5(pid=5215) [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5215)] [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 16:22:18.887070 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:22:18.914389 run osmo-hlr_10.42.42.2(pid=5212): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5212)] 16:22:18.962122 run osmo-hlr_10.42.42.2(pid=5212): stdout: | (launched: 2022-12-13_16:22:15.370513) 16:22:19.011809 run osmo-hlr_10.42.42.2(pid=5212): stderr: | [0;m[1;31m20221213162215545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162215545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162215545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162215546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162215546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162215546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162215558 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162215568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162215568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162215569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:19.062057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5205): Terminating (SIGTERM) 16:22:19.102249 run iperf3-srv_10.42.42.10(pid=5206): Terminating (SIGTERM) 16:22:19.141899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5207): Terminating (SIGTERM) 16:22:19.181660 run iperf3-srv_10.42.42.10(pid=5208): Terminating (SIGTERM) 16:22:19.221362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5211): Terminating (SIGTERM) 16:22:19.261125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5214): Terminating (SIGTERM) 16:22:19.300690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5217): Terminating (SIGTERM) 16:22:19.340544 --- ParallelTerminationStrategy: PID 5205 died... 16:22:19.359840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5205): Terminated: ok {rc=0} 16:22:19.403938 --- ParallelTerminationStrategy: PID 5206 died... 16:22:19.422409 run iperf3-srv_10.42.42.10(pid=5206): Terminated {rc=256} 16:22:19.465971 --- ParallelTerminationStrategy: PID 5207 died... 16:22:19.484521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5207): Terminated: ok {rc=0} 16:22:19.527870 --- ParallelTerminationStrategy: PID 5208 died... 16:22:19.546349 run iperf3-srv_10.42.42.10(pid=5208): Terminated {rc=256} 16:22:19.589791 --- ParallelTerminationStrategy: PID 5211 died... 16:22:19.608395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5211): Terminated: ok {rc=0} 16:22:19.651938 --- ParallelTerminationStrategy: PID 5214 died... 16:22:19.670613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5214): Terminated: ok {rc=0} 16:22:19.714948 --- ParallelTerminationStrategy: PID 5217 died... 16:22:19.733624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5217): Terminated: ok {rc=0} 16:22:19.819266 bus /gobi_0: Setting Powered False 16:22:20.919975 bus /gobi_0: Setting Powered False 16:22:22.035274 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 16:22:23.181847 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:23.194159 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:22:23.252882 tst iperf3.py: using LAC 34806 16:22:23.386856 tst iperf3.py: using RAC 126 16:22:23.514843 tst iperf3.py: using CellId 34806 16:22:23.643263 tst iperf3.py: using BVCI 34807 16:22:23.763179 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:23.775295 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:23.787066 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:23.798761 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:23.810795 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:23.822863 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:23.834995 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:23.846943 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:23.859187 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:22:23.977146 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:22:24.184284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:24.494578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5219): Launched 16:22:24.766839 run iperf3-srv_10.42.42.10(pid=5220): Launched 16:22:24.884873 tst iperf3.py:8: start network... 16:22:25.091438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:25.569449 run create_hlr_db(pid=5221): Launched 16:22:25.696248 bus /gobi_6: Setting Powered False 16:22:26.759785 run create_hlr_db(pid=5221): Terminated: ok {rc=0} 16:22:27.217621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5223): Launched 16:22:27.547511 run osmo-hlr_10.42.42.2(pid=5224): Launched 16:22:27.675268 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:28.246198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5226): Launched 16:22:28.576652 run osmo-stp_10.42.42.5(pid=5227): Launched 16:22:28.703215 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:22:29.271633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5229): Launched 16:22:29.400564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:22:29.679883 run patchelf(pid=5230): Launched 16:22:29.866276 run osmo-stp_10.42.42.5(pid=5227): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5227)] 16:22:30.006152 run osmo-stp_10.42.42.5(pid=5227): stdout: | (launched: 2022-12-13_16:22:28.516286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:30.148105 run osmo-stp_10.42.42.5(pid=5227): stderr: | [0;m[38;5;43m20221213162228707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162228707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162228707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162228707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162228708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162228708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162228708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:30.289751 run osmo-stp_10.42.42.5(pid=5227): stdout: | (launched: 2022-12-13_16:22:28.516286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:30.424886 run osmo-stp_10.42.42.5(pid=5227): stderr: | [0;m[38;5;43m20221213162228707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162228707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162228707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162228707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162228708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162228708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162228708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:30.585091 run patchelf(pid=5230): Terminating (SIGINT) 16:22:30.770111 run patchelf(pid=5230): Terminated: ok {rc=0} 16:22:30.920866 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5227): Process ended prematurely: osmo-stp_10.42.42.5(pid=5227) [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5227)] [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 16:22:30.931316 tst iperf3.py:8: Test FAILED (7.8 sec) 16:22:30.959515 run osmo-hlr_10.42.42.2(pid=5224): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5224)] 16:22:31.009351 run osmo-hlr_10.42.42.2(pid=5224): stdout: | (launched: 2022-12-13_16:22:27.487501) 16:22:31.060689 run osmo-hlr_10.42.42.2(pid=5224): stderr: | [0;m[1;31m20221213162227684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162227684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162227684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162227684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162227684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162227685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162227697 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162227706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162227706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162227706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:31.113407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5219): Terminating (SIGTERM) 16:22:31.154887 run iperf3-srv_10.42.42.10(pid=5220): Terminating (SIGTERM) 16:22:31.196652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5223): Terminating (SIGTERM) 16:22:31.238980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5226): Terminating (SIGTERM) 16:22:31.284393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5229): Terminating (SIGTERM) 16:22:31.328323 --- ParallelTerminationStrategy: PID 5219 died... 16:22:31.348842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5219): Terminated: ok {rc=0} 16:22:31.396001 --- ParallelTerminationStrategy: PID 5220 died... 16:22:31.415554 run iperf3-srv_10.42.42.10(pid=5220): Terminated {rc=256} 16:22:31.461812 --- ParallelTerminationStrategy: PID 5223 died... 16:22:31.481333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5223): Terminated: ok {rc=0} 16:22:31.527388 --- ParallelTerminationStrategy: PID 5226 died... 16:22:31.547248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5226): Terminated: ok {rc=0} 16:22:31.592923 --- ParallelTerminationStrategy: PID 5229 died... 16:22:31.612629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5229): Terminated: ok {rc=0} 16:22:31.705952 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 16:22:32.871267 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:32.884213 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:22:32.939313 tst iperf3m4.py: using LAC 34807 16:22:33.069821 tst iperf3m4.py: using RAC 127 16:22:33.198665 tst iperf3m4.py: using CellId 34807 16:22:33.328314 tst iperf3m4.py: using BVCI 34808 16:22:33.447763 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:33.459659 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:33.471431 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:33.483274 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:33.495325 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:33.507260 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:33.519435 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:33.531439 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:33.543841 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:22:33.667553 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:22:33.790046 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:22:33.912109 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:22:34.032493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:22:34.238072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:34.545663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5231): Launched 16:22:34.814501 run iperf3-srv_10.42.42.10(pid=5232): Launched 16:22:34.932210 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:22:35.138070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:35.446983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5233): Launched 16:22:35.715212 run iperf3-srv_10.42.42.10(pid=5234): Launched 16:22:35.831615 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:22:36.037632 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:36.346391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5235): Launched 16:22:36.616290 run iperf3-srv_10.42.42.10(pid=5236): Launched 16:22:36.731356 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:22:36.936188 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:37.244722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5237): Launched 16:22:37.512747 run iperf3-srv_10.42.42.10(pid=5238): Launched 16:22:37.628316 tst iperf3m4.py:8: start network... 16:22:37.834094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:38.310979 run create_hlr_db(pid=5239): Launched 16:22:38.439560 bus /gobi_6: Setting Powered False 16:22:39.500051 run create_hlr_db(pid=5239): Terminated: ok {rc=0} 16:22:39.950155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5241): Launched 16:22:40.282148 run osmo-hlr_10.42.42.2(pid=5242): Launched 16:22:40.409057 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:40.977629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5244): Launched 16:22:41.308886 run osmo-stp_10.42.42.5(pid=5245): Launched 16:22:41.438483 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:22:42.007616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5247): Launched 16:22:42.137636 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:22:42.417388 run patchelf(pid=5248): Launched 16:22:42.603810 run osmo-stp_10.42.42.5(pid=5245): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5245)] 16:22:42.744308 run osmo-stp_10.42.42.5(pid=5245): stdout: | (launched: 2022-12-13_16:22:41.248499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:42.887097 run osmo-stp_10.42.42.5(pid=5245): stderr: | [0;m[38;5;43m20221213162241438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162241438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162241438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162241439 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162241439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162241439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162241440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:43.030417 run osmo-stp_10.42.42.5(pid=5245): stdout: | (launched: 2022-12-13_16:22:41.248499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:43.166686 run osmo-stp_10.42.42.5(pid=5245): stderr: | [0;m[38;5;43m20221213162241438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162241438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162241438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162241439 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162241439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162241439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162241440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:43.328223 run patchelf(pid=5248): Terminating (SIGINT) 16:22:43.515417 run patchelf(pid=5248): Terminated: ok {rc=0} 16:22:43.650450 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5245): Process ended prematurely: osmo-stp_10.42.42.5(pid=5245) [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5245)] [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 16:22:43.660864 tst iperf3m4.py:8: Test FAILED (10.8 sec) 16:22:43.690290 run osmo-hlr_10.42.42.2(pid=5242): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5242)] 16:22:43.742141 run osmo-hlr_10.42.42.2(pid=5242): stdout: | (launched: 2022-12-13_16:22:40.221556) 16:22:43.795187 run osmo-hlr_10.42.42.2(pid=5242): stderr: | [0;m[1;31m20221213162240415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162240415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162240415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162240415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162240416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162240416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162240428 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162240437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162240438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162240438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:43.848309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5231): Terminating (SIGTERM) 16:22:43.890675 run iperf3-srv_10.42.42.10(pid=5232): Terminating (SIGTERM) 16:22:43.933789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5233): Terminating (SIGTERM) 16:22:43.976369 run iperf3-srv_10.42.42.10(pid=5234): Terminating (SIGTERM) 16:22:44.019290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5235): Terminating (SIGTERM) 16:22:44.062281 run iperf3-srv_10.42.42.10(pid=5236): Terminating (SIGTERM) 16:22:44.104915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5237): Terminating (SIGTERM) 16:22:44.147527 run iperf3-srv_10.42.42.10(pid=5238): Terminating (SIGTERM) 16:22:44.190550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5241): Terminating (SIGTERM) 16:22:44.233249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5244): Terminating (SIGTERM) 16:22:44.276396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5247): Terminating (SIGTERM) 16:22:44.319442 --- ParallelTerminationStrategy: PID 5231 died... 16:22:44.339966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5231): Terminated: ok {rc=0} 16:22:44.386954 --- ParallelTerminationStrategy: PID 5232 died... 16:22:44.406876 run iperf3-srv_10.42.42.10(pid=5232): Terminated {rc=256} 16:22:44.453428 --- ParallelTerminationStrategy: PID 5233 died... 16:22:44.473410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5233): Terminated: ok {rc=0} 16:22:44.520010 --- ParallelTerminationStrategy: PID 5234 died... 16:22:44.539859 run iperf3-srv_10.42.42.10(pid=5234): Terminated {rc=256} 16:22:44.586759 --- ParallelTerminationStrategy: PID 5235 died... 16:22:44.606707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5235): Terminated: ok {rc=0} 16:22:44.653171 --- ParallelTerminationStrategy: PID 5236 died... 16:22:44.673081 run iperf3-srv_10.42.42.10(pid=5236): Terminated {rc=256} 16:22:44.719539 --- ParallelTerminationStrategy: PID 5237 died... 16:22:44.739515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5237): Terminated: ok {rc=0} 16:22:44.786195 --- ParallelTerminationStrategy: PID 5238 died... 16:22:44.806080 run iperf3-srv_10.42.42.10(pid=5238): Terminated {rc=256} 16:22:44.852489 --- ParallelTerminationStrategy: PID 5241 died... 16:22:44.872706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5241): Terminated: ok {rc=0} 16:22:44.919170 --- ParallelTerminationStrategy: PID 5244 died... 16:22:44.939115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5244): Terminated: ok {rc=0} 16:22:44.986093 --- ParallelTerminationStrategy: PID 5247 died... 16:22:45.006003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5247): Terminated: ok {rc=0} 16:22:45.094971 bus /gobi_4: Setting Powered False 16:22:46.201455 bus /gobi_4: Setting Powered False 16:22:47.331780 bus /gobi_1: Setting Powered False 16:22:48.430775 bus /gobi_1: Setting Powered False 16:22:49.549125 bus /gobi_0: Setting Powered False 16:22:50.647631 bus /gobi_0: Setting Powered False 16:22:51.765146 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 16:22:52.867558 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:52.879850 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:22:52.931875 tst ping.py: using LAC 34808 16:22:53.053483 tst ping.py: using RAC 128 16:22:53.174710 tst ping.py: using CellId 34808 16:22:53.294646 tst ping.py: using BVCI 34809 16:22:53.406095 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:53.417616 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:53.428708 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:53.439911 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:53.451234 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:53.462769 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:53.474273 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:22:53.485691 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:22:53.607769 tst ping.py:19: start network... 16:22:53.828082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:54.333338 run create_hlr_db(pid=5251): Launched 16:22:54.459481 bus /gobi_6: Setting Powered False 16:22:55.523144 run create_hlr_db(pid=5251): Terminated: ok {rc=0} 16:22:55.959011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5253): Launched 16:22:56.265633 run osmo-hlr_10.42.42.2(pid=5254): Launched 16:22:56.382296 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:56.925877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5256): Launched 16:22:57.233781 run osmo-stp_10.42.42.5(pid=5257): Launched 16:22:57.350178 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:22:57.877323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5259): Launched 16:22:57.994750 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:22:58.255166 run patchelf(pid=5260): Launched 16:22:58.426261 run osmo-stp_10.42.42.5(pid=5257): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5257)] 16:22:58.556030 run osmo-stp_10.42.42.5(pid=5257): stdout: | (launched: 2022-12-13_16:22:57.177120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:58.688157 run osmo-stp_10.42.42.5(pid=5257): stderr: | [0;m[38;5;43m20221213162257347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162257347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162257347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162257348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162257348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162257348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162257348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:58.819817 run osmo-stp_10.42.42.5(pid=5257): stdout: | (launched: 2022-12-13_16:22:57.177120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:58.945328 run osmo-stp_10.42.42.5(pid=5257): stderr: | [0;m[38;5;43m20221213162257347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162257347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162257347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162257348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162257348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162257348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162257348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:59.093583 run patchelf(pid=5260): Terminating (SIGINT) 16:22:59.265146 run patchelf(pid=5260): Terminated: ok {rc=0} 16:22:59.388669 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5257): Process ended prematurely: osmo-stp_10.42.42.5(pid=5257) [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5257)] [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 16:22:59.397884 tst ping.py:22: Test FAILED (6.5 sec) 16:22:59.424885 run osmo-hlr_10.42.42.2(pid=5254): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5254)] 16:22:59.473445 run osmo-hlr_10.42.42.2(pid=5254): stdout: | (launched: 2022-12-13_16:22:56.209058) 16:22:59.523287 run osmo-hlr_10.42.42.2(pid=5254): stderr: | [0;m[1;31m20221213162256384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162256384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162256384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162256384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162256385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162256385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162256397 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162256407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162256407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162256407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:59.573703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5253): Terminating (SIGTERM) 16:22:59.613773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5256): Terminating (SIGTERM) 16:22:59.653701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5259): Terminating (SIGTERM) 16:22:59.694696 --- ParallelTerminationStrategy: PID 5253 died... 16:22:59.713976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5253): Terminated: ok {rc=0} 16:22:59.758121 --- ParallelTerminationStrategy: PID 5256 died... 16:22:59.776714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5256): Terminated: ok {rc=0} 16:22:59.821259 --- ParallelTerminationStrategy: PID 5259 died... 16:22:59.839817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5259): Terminated: ok {rc=0} 16:22:59.924073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 16:23:01.008503 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:23:01.021518 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:23:01.077052 tst ping_idle_ping.py: using LAC 34809 16:23:01.202809 tst ping_idle_ping.py: using RAC 129 16:23:01.328662 tst ping_idle_ping.py: using CellId 34809 16:23:01.483798 tst ping_idle_ping.py: using BVCI 34810 16:23:01.606372 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:23:01.619583 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:23:01.632529 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:23:01.645695 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:23:01.659184 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:23:01.673663 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:23:01.688492 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:23:01.702641 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:23:01.856892 tst ping_idle_ping.py:24: start network... 16:23:02.074559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:02.553447 run create_hlr_db(pid=5261): Launched 16:23:02.679663 bus /gobi_6: Setting Powered False 16:23:03.740673 run create_hlr_db(pid=5261): Terminated: ok {rc=0} 16:23:04.189739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5263): Launched 16:23:04.518451 run osmo-hlr_10.42.42.2(pid=5264): Launched 16:23:04.645842 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:05.211473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5266): Launched 16:23:05.540537 run osmo-stp_10.42.42.5(pid=5267): Launched 16:23:05.667506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:23:06.233626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5269): Launched 16:23:06.354445 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:23:06.612150 run patchelf(pid=5270): Launched 16:23:06.782899 run osmo-stp_10.42.42.5(pid=5267): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5267)] 16:23:06.912233 run osmo-stp_10.42.42.5(pid=5267): stdout: | (launched: 2022-12-13_16:23:05.479890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:07.044049 run osmo-stp_10.42.42.5(pid=5267): stderr: | [0;m[38;5;43m20221213162305672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162305673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162305673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162305673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162305674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162305674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162305674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:07.175811 run osmo-stp_10.42.42.5(pid=5267): stdout: | (launched: 2022-12-13_16:23:05.479890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:07.300527 run osmo-stp_10.42.42.5(pid=5267): stderr: | [0;m[38;5;43m20221213162305672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162305673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162305673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162305673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162305674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162305674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162305674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:07.449111 run patchelf(pid=5270): Terminating (SIGINT) 16:23:07.620426 run patchelf(pid=5270): Terminated: ok {rc=0} 16:23:07.744122 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5267): Process ended prematurely: osmo-stp_10.42.42.5(pid=5267) [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5267)] [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 16:23:07.753230 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:23:07.780123 run osmo-hlr_10.42.42.2(pid=5264): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5264)] 16:23:07.827750 run osmo-hlr_10.42.42.2(pid=5264): stdout: | (launched: 2022-12-13_16:23:04.457787) 16:23:07.876894 run osmo-hlr_10.42.42.2(pid=5264): stderr: | [0;m[1;31m20221213162304655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162304655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162304655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162304655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162304655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162304655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162304672 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162304682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162304682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162304682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:07.926593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5263): Terminating (SIGTERM) 16:23:07.966133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5266): Terminating (SIGTERM) 16:23:08.005841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5269): Terminating (SIGTERM) 16:23:08.045674 --- ParallelTerminationStrategy: PID 5263 died... 16:23:08.064718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5263): Terminated: ok {rc=0} 16:23:08.109355 --- ParallelTerminationStrategy: PID 5266 died... 16:23:08.128165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5266): Terminated: ok {rc=0} 16:23:08.172026 --- ParallelTerminationStrategy: PID 5269 died... 16:23:08.190805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5269): Terminated: ok {rc=0} 16:23:08.276564 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:23:09.585443 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:09.592066 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:23:09.624339 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:23:09.658942 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:23:09.711373 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:23:09.743889 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:23:09.778486 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:23:10.345515 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:23:10.350530 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:23:10.361876 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:23:10.435925 tst switch_tch_pdch.py: using LAC 34810 16:23:10.555452 tst switch_tch_pdch.py: using RAC 130 16:23:10.672513 tst switch_tch_pdch.py: using CellId 34810 16:23:10.790180 tst switch_tch_pdch.py: using BVCI 34811 16:23:10.900167 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:23:10.911489 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:23:10.922753 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:23:10.933967 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:23:10.945133 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:23:10.956128 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:23:10.967419 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:23:10.978611 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:23:11.099723 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:23:11.219442 tst switch_tch_pdch.py:51: start network... 16:23:11.424933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:11.896661 run create_hlr_db(pid=5275): Launched 16:23:12.022436 bus /gobi_6: Setting Powered False 16:23:13.083034 run create_hlr_db(pid=5275): Terminated: ok {rc=0} 16:23:13.508529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5277): Launched 16:23:13.814819 run osmo-hlr_10.42.42.2(pid=5278): Launched 16:23:13.931077 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:14.473005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5280): Launched 16:23:14.778158 run osmo-stp_10.42.42.5(pid=5281): Launched 16:23:14.894762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:23:15.420913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5283): Launched 16:23:15.537980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:23:15.795432 run patchelf(pid=5284): Launched 16:23:15.999691 run osmo-stp_10.42.42.5(pid=5281): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5281)] 16:23:16.130980 run osmo-stp_10.42.42.5(pid=5281): stdout: | (launched: 2022-12-13_16:23:14.721766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:16.265346 run osmo-stp_10.42.42.5(pid=5281): stderr: | [0;m[38;5;43m20221213162314894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162314894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162314894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162314894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162314895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162314895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162314895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:16.398854 run osmo-stp_10.42.42.5(pid=5281): stdout: | (launched: 2022-12-13_16:23:14.721766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:16.525236 run osmo-stp_10.42.42.5(pid=5281): stderr: | [0;m[38;5;43m20221213162314894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162314894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162314894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162314894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162314895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162314895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162314895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:16.675174 run patchelf(pid=5284): Terminating (SIGINT) 16:23:16.849292 run patchelf(pid=5284): Terminated: ok {rc=0} 16:23:16.975428 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5281): Process ended prematurely: osmo-stp_10.42.42.5(pid=5281) [trial-2391↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5281)] [trial-2391↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:23:16.985728 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 16:23:17.013844 run osmo-hlr_10.42.42.2(pid=5278): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5278)] 16:23:17.063179 run osmo-hlr_10.42.42.2(pid=5278): stdout: | (launched: 2022-12-13_16:23:13.758228) 16:23:17.113488 run osmo-hlr_10.42.42.2(pid=5278): stderr: | [0;m[1;31m20221213162313933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162313933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162313933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162313933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162313933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162313933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162313945 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162313954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162313954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162313954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:17.164171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5277): Terminating (SIGTERM) 16:23:17.205191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5280): Terminating (SIGTERM) 16:23:17.245205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5283): Terminating (SIGTERM) 16:23:17.285326 --- ParallelTerminationStrategy: PID 5277 died... 16:23:17.304468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5277): Terminated: ok {rc=0} 16:23:17.348346 --- ParallelTerminationStrategy: PID 5280 died... 16:23:17.367003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5280): Terminated: ok {rc=0} 16:23:17.410850 --- ParallelTerminationStrategy: PID 5283 died... 16:23:17.430076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5283): Terminated: ok {rc=0} 16:23:17.516396 bus /gobi_0: Setting Powered False 16:23:18.616304 bus /gobi_0: Setting Powered False 16:23:19.732916 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:23:20.986398 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:20.992318 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:23:21.024858 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:23:21.060163 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:23:21.113447 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:23:21.147633 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:23:21.183847 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:23:21.737673 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:23:21.742760 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:23:21.753918 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:23:21.824547 tst switch_tch_pdch.py: using LAC 34811 16:23:21.945509 tst switch_tch_pdch.py: using RAC 131 16:23:22.074329 tst switch_tch_pdch.py: using CellId 34811 16:23:22.203897 tst switch_tch_pdch.py: using BVCI 34812 16:23:22.324224 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:23:22.336001 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:23:22.347644 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:23:22.359254 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:23:22.371201 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:23:22.383048 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:23:22.395089 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:23:22.406803 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:23:22.526929 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:23:22.644232 tst switch_tch_pdch.py:51: start network... 16:23:22.847948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:23.293324 run create_hlr_db(pid=5288): Launched 16:23:23.419152 bus /gobi_6: Setting Powered False 16:23:24.479719 run create_hlr_db(pid=5288): Terminated: ok {rc=0} 16:23:24.897175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5290): Launched 16:23:25.225296 run osmo-hlr_10.42.42.2(pid=5291): Launched 16:23:25.350531 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:25.888043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5293): Launched 16:23:26.215803 run osmo-stp_10.42.42.5(pid=5294): Launched 16:23:26.341416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:23:26.876376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5296): Launched 16:23:27.003651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:23:27.280306 run patchelf(pid=5297): Launched 16:23:27.463679 run osmo-stp_10.42.42.5(pid=5294): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5294)] 16:23:27.601864 run osmo-stp_10.42.42.5(pid=5294): stdout: | (launched: 2022-12-13_16:23:26.155866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:27.741972 run osmo-stp_10.42.42.5(pid=5294): stderr: | [0;m[38;5;43m20221213162326346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162326346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162326347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162326347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162326348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162326348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162326348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:27.882799 run osmo-stp_10.42.42.5(pid=5294): stdout: | (launched: 2022-12-13_16:23:26.155866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:28.016435 run osmo-stp_10.42.42.5(pid=5294): stderr: | [0;m[38;5;43m20221213162326346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162326346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162326347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162326347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162326348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162326348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162326348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:28.174774 run patchelf(pid=5297): Terminating (SIGINT) 16:23:28.357893 run patchelf(pid=5297): Terminated: ok {rc=0} 16:23:28.490033 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5294): Process ended prematurely: osmo-stp_10.42.42.5(pid=5294) [trial-2391↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5294)] [trial-2391↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:23:28.500132 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 16:23:28.528496 run osmo-hlr_10.42.42.2(pid=5291): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5291)] 16:23:28.579822 run osmo-hlr_10.42.42.2(pid=5291): stdout: | (launched: 2022-12-13_16:23:25.165303) 16:23:28.632591 run osmo-hlr_10.42.42.2(pid=5291): stderr: | [0;m[1;31m20221213162325364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162325364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162325364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162325364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162325364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162325364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162325379 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162325389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162325390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162325390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:28.685823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5290): Terminating (SIGTERM) 16:23:28.728199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5293): Terminating (SIGTERM) 16:23:28.771331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5296): Terminating (SIGTERM) 16:23:28.814243 --- ParallelTerminationStrategy: PID 5290 died... 16:23:28.834816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5290): Terminated: ok {rc=0} 16:23:28.881638 --- ParallelTerminationStrategy: PID 5293 died... 16:23:28.901741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5293): Terminated: ok {rc=0} 16:23:28.948230 --- ParallelTerminationStrategy: PID 5296 died... 16:23:28.968352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5296): Terminated: ok {rc=0} 16:23:29.058220 bus /gobi_0: Setting Powered False 16:23:30.154805 bus /gobi_0: Setting Powered False 16:23:31.284458 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_sms:trx-lms --------------------------------------------------------------------- 16:23:32.540611 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:32.544465 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 16:23:32.577360 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 16:23:32.584240 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 16:23:32.636035 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 16:23:32.669028 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 16:23:32.675738 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 16:23:33.214682 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 16:23:33.221316 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 16:23:33.233571 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 16:23:33.289076 tst mo_mt_sms.py: using LAC 34812 16:23:33.417701 tst mo_mt_sms.py: using RAC 132 16:23:33.545644 tst mo_mt_sms.py: using CellId 34812 16:23:33.673960 tst mo_mt_sms.py: using BVCI 34813 16:23:33.793518 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 16:23:33.913092 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 16:23:34.029478 tst mo_mt_sms.py:9: start nitb and bts... 16:23:34.234775 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:23:34.856026 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5301): Launched 16:23:35.161788 run osmo-nitb_10.42.42.2(pid=5302): Launched 16:23:35.330487 run osmo-nitb_10.42.42.2(pid=5302): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5302)] 16:23:35.467170 run osmo-nitb_10.42.42.2(pid=5302): stdout: | (launched: 2022-12-13_16:23:35.105141) 16:23:35.605437 run osmo-nitb_10.42.42.2(pid=5302): stderr: | (launched: 2022-12-13_16:23:35.150744) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:23:35.743373 run osmo-nitb_10.42.42.2(pid=5302): stdout: | (launched: 2022-12-13_16:23:35.105141) 16:23:35.875418 run osmo-nitb_10.42.42.2(pid=5302): stderr: | (launched: 2022-12-13_16:23:35.150744) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5302): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5302) [trial-2391↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5302)] 16:23:36.276553 tst osmo-nitb_10.42.42.2(pid=5302): stdout: | (launched: 2022-12-13_16:23:35.105141) 16:23:36.399793 tst osmo-nitb_10.42.42.2(pid=5302): stderr: | (launched: 2022-12-13_16:23:35.150744) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:23:36.544699 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=5302): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5302) [trial-2391↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5302)] [trial-2391↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 16:23:36.553234 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 16:23:36.559860 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5301): Terminating (SIGTERM) 16:23:36.768408 --- ParallelTerminationStrategy: PID 5301 died... 16:23:36.788874 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5301): Terminated: ok {rc=0} 16:23:36.876105 bus /sierra_3: Setting Powered False 16:23:37.977046 bus /sierra_3: Setting Powered False 16:23:39.092508 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 sms:trx-lms --------------------------------------------------------------------- 16:23:40.293377 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:40.297455 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 16:23:40.330557 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:23:40.357534 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 16:23:40.409197 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 16:23:40.442301 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:23:40.468878 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 16:23:41.015412 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 16:23:41.020353 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:41.031119 tst sms:trx-lms: Using 1 x bts (candidates: 1) 16:23:41.078622 tst mo_mt_sms.py: using LAC 34813 16:23:41.199742 tst mo_mt_sms.py: using RAC 133 16:23:41.322800 tst mo_mt_sms.py: using CellId 34813 16:23:41.442080 tst mo_mt_sms.py: using BVCI 34814 16:23:41.551635 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:41.562245 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:41.572687 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:41.583212 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:41.593659 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:41.604020 tst sms:trx-lms: Using 1 x modem (candidates: 2) 16:23:41.726810 tst sms:trx-lms: Using 1 x modem (candidates: 2) 16:23:41.846264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:42.317683 run create_hlr_db(pid=5306): Launched 16:23:42.443068 bus /sierra_2: Setting Powered False 16:23:43.503484 run create_hlr_db(pid=5306): Terminated: ok {rc=0} 16:23:43.929333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5308): Launched 16:23:44.236547 run osmo-hlr_10.42.42.2(pid=5309): Launched 16:23:44.352775 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:44.877816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5311): Launched 16:23:45.183344 run osmo-stp_10.42.42.5(pid=5312): Launched 16:23:45.300217 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:45.859631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5314): Launched 16:23:46.198164 run osmo-msc_10.42.42.6(pid=5315): Launched 16:23:46.535163 run osmo-stp_10.42.42.5(pid=5312): ERR: Terminated: ERROR {rc=1} [trial-2391↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5312)] 16:23:46.712024 run osmo-stp_10.42.42.5(pid=5312): stdout: | (launched: 2022-12-13_16:23:45.126827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:46.998403 run osmo-stp_10.42.42.5(pid=5312): stderr: | [0;m[38;5;43m20221213162345297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162345297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162345297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162345297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162345298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162345298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162345298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:47.153869 run osmo-stp_10.42.42.5(pid=5312): stdout: | (launched: 2022-12-13_16:23:45.126827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:47.298653 run osmo-stp_10.42.42.5(pid=5312): stderr: | [0;m[38;5;43m20221213162345297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162345297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162345297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162345297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162345298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162345298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162345298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:47.489791 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5312): Process ended prematurely: osmo-stp_10.42.42.5(pid=5312) [trial-2391↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5312)] [trial-2391↪sms:trx-lms↪mo_mt_sms.py:16] 16:23:47.502542 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 16:23:47.534764 run osmo-hlr_10.42.42.2(pid=5309): ERR: Terminated: ERROR {rc=237} [trial-2391↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5309)] 16:23:47.593405 run osmo-hlr_10.42.42.2(pid=5309): stdout: | (launched: 2022-12-13_16:23:44.179901) 16:23:47.649222 run osmo-hlr_10.42.42.2(pid=5309): stderr: | [0;m[1;31m20221213162344357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162344357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162344357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162344357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162344358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162344358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162344369 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162344378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162344379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162344379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:47.727223 run osmo-msc_10.42.42.6(pid=5315): ERR: Terminated: ERROR {rc=2} [trial-2391↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5315)] 16:23:47.780002 run osmo-msc_10.42.42.6(pid=5315): stdout: | (launched: 2022-12-13_16:23:46.140577) 16:23:47.849166 run osmo-msc_10.42.42.6(pid=5315): stderr: | [0;m[38;5;43m20221213162346699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162346699 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa8bba60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162346699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162346699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162346700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162346700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162346702 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162346702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162346702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162346702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:47.906185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5308): Terminating (SIGTERM) 16:23:47.951357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5311): Terminating (SIGTERM) 16:23:47.998620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5314): Terminating (SIGTERM) 16:23:48.056062 --- ParallelTerminationStrategy: PID 5308 died... 16:23:48.084746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5308): Terminated: ok {rc=0} 16:23:48.148588 --- ParallelTerminationStrategy: PID 5311 died... 16:23:48.173803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5311): Terminated: ok {rc=0} 16:23:48.229898 --- ParallelTerminationStrategy: PID 5314 died... 16:23:48.255000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5314): Terminated: ok {rc=0} 16:23:48.355986 bus /sierra_3: Setting Powered False 16:23:49.480236 bus /sierra_3: Setting Powered False 16:23:50.602190 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_ussd:trx-lms --------------------------------------------------------------------- 16:23:51.845462 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:51.850226 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 16:23:51.886034 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 16:23:51.893981 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 16:23:51.927643 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 16:23:51.962894 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 16:23:51.971218 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 16:23:52.493505 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2391 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 16:23:52.499853 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 16:23:52.511711 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 16:23:52.564043 tst assert_extension.py: using LAC 34814 16:23:52.685770 tst assert_extension.py: using RAC 134 16:23:52.807291 tst assert_extension.py: using CellId 34814 16:23:52.927701 tst assert_extension.py: using BVCI 34815 16:23:53.041179 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 16:23:53.157944 tst assert_extension.py:10: start nitb and bts... 16:23:53.365482 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:23:54.004887 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5591): Launched 16:23:54.332665 run osmo-nitb_10.42.42.2(pid=5592): Launched 16:23:54.528714 run osmo-nitb_10.42.42.2(pid=5592): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5592)] 16:23:54.671161 run osmo-nitb_10.42.42.2(pid=5592): stdout: | (launched: 2022-12-13_16:23:54.274869) 16:23:54.815914 run osmo-nitb_10.42.42.2(pid=5592): stderr: | (launched: 2022-12-13_16:23:54.321519) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:23:54.959340 run osmo-nitb_10.42.42.2(pid=5592): stdout: | (launched: 2022-12-13_16:23:54.274869) 16:23:55.096530 run osmo-nitb_10.42.42.2(pid=5592): stderr: | (launched: 2022-12-13_16:23:54.321519) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5592): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5592) [trial-2391↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5592)] 16:23:55.471692 tst osmo-nitb_10.42.42.2(pid=5592): stdout: | (launched: 2022-12-13_16:23:54.274869) 16:23:55.600840 tst osmo-nitb_10.42.42.2(pid=5592): stderr: | (launched: 2022-12-13_16:23:54.321519) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:23:55.753428 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5592): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5592) [trial-2391↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5592)] [trial-2391↪nitb_ussd:trx-lms↪assert_extension.py:12] 16:23:55.763247 tst assert_extension.py:12: Test FAILED (3.3 sec) 16:23:55.771004 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5591): Terminating (SIGTERM) 16:23:55.983680 --- ParallelTerminationStrategy: PID 5591 died... 16:23:56.007394 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5591): Terminated: ok {rc=0} 16:23:56.098108 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 ussd:trx-lms --------------------------------------------------------------------- 16:23:57.279937 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:57.284300 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 16:23:57.318252 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:23:57.347690 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 16:23:57.383330 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 16:23:57.418272 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:23:57.446889 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 16:23:57.973649 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2391 ussd:trx-lms assert_extension.py ---------------------------------------------- 16:23:57.980564 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:57.992340 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 16:23:58.051593 tst assert_extension.py: using LAC 34815 16:23:58.177959 tst assert_extension.py: using RAC 135 16:23:58.301982 tst assert_extension.py: using CellId 34815 16:23:58.423131 tst assert_extension.py: using BVCI 34816 16:23:58.540567 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:58.552272 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:58.564414 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:58.576048 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:58.589248 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:23:58.601875 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 16:23:58.727170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:59.220646 run create_hlr_db(pid=5602): Launched 16:23:59.386810 bus /sierra_2: Setting Powered False 16:24:00.448900 run create_hlr_db(pid=5602): Terminated: ok {rc=0} 16:24:00.920142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5604): Launched 16:24:01.298499 run osmo-hlr_10.42.42.2(pid=5605): Launched 16:24:01.566742 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:02.385285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5607): Launched 16:24:02.742027 run osmo-stp_10.42.42.5(pid=5608): Launched 16:24:02.973347 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:03.662269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5610): Launched 16:24:03.997208 run osmo-msc_10.42.42.6(pid=5611): Launched 16:24:04.349495 run osmo-stp_10.42.42.5(pid=5608): ERR: Terminated: ERROR {rc=1} [trial-2391↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5608)] 16:24:04.627005 run osmo-stp_10.42.42.5(pid=5608): stdout: | (launched: 2022-12-13_16:24:02.681790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:04.907785 run osmo-stp_10.42.42.5(pid=5608): stderr: | [0;m[38;5;43m20221213162402983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162402983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162402983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162402984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162402984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162402984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162402984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:05.062057 run osmo-stp_10.42.42.5(pid=5608): stdout: | (launched: 2022-12-13_16:24:02.681790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:05.187889 run osmo-stp_10.42.42.5(pid=5608): stderr: | [0;m[38;5;43m20221213162402983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162402983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162402983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162402984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162402984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162402984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162402984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:05.338795 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5608): Process ended prematurely: osmo-stp_10.42.42.5(pid=5608) [trial-2391↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5608)] [trial-2391↪ussd:trx-lms↪assert_extension.py:17] 16:24:05.347894 tst assert_extension.py:17: Test FAILED (7.4 sec) 16:24:05.374950 run osmo-hlr_10.42.42.2(pid=5605): ERR: Terminated: ERROR {rc=237} [trial-2391↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5605)] 16:24:05.424699 run osmo-hlr_10.42.42.2(pid=5605): stdout: | (launched: 2022-12-13_16:24:01.210020) 16:24:05.477641 run osmo-hlr_10.42.42.2(pid=5605): stderr: | [0;m[1;31m20221213162401602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162401602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162401603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162401603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162401603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162401603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162401623 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162401638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162401638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162401638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:05.550431 run osmo-msc_10.42.42.6(pid=5611): ERR: Terminated: ERROR {rc=2} [trial-2391↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5611)] 16:24:05.600943 run osmo-msc_10.42.42.6(pid=5611): stdout: | (launched: 2022-12-13_16:24:03.934107) 16:24:05.652876 run osmo-msc_10.42.42.6(pid=5611): stderr: | [0;m[38;5;43m20221213162404529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162404529 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f00491cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162404529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162404529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162404530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162404530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162404531 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162404532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162404532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162404532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:05.707335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5604): Terminating (SIGTERM) 16:24:05.750922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5607): Terminating (SIGTERM) 16:24:05.796938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5610): Terminating (SIGTERM) 16:24:05.841864 --- ParallelTerminationStrategy: PID 5604 died... 16:24:05.862486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5604): Terminated: ok {rc=0} 16:24:05.911960 --- ParallelTerminationStrategy: PID 5607 died... 16:24:05.931688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5607): Terminated: ok {rc=0} 16:24:05.978058 --- ParallelTerminationStrategy: PID 5610 died... 16:24:05.997911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5610): Terminated: ok {rc=0} 16:24:06.087568 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:24:07.302190 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:07.309758 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:24:07.344663 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:24:07.373367 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:24:07.431386 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:24:07.467310 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:24:07.498606 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:24:08.039299 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:24:08.096424 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:08.109134 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:24:08.180933 tst mo_mt_call.py: using LAC 34816 16:24:08.307232 tst mo_mt_call.py: using RAC 136 16:24:08.432217 tst mo_mt_call.py: using CellId 34816 16:24:08.558354 tst mo_mt_call.py: using BVCI 34817 16:24:08.676724 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:08.689184 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:08.702072 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:08.714185 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:08.727716 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:08.740121 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:24:08.862761 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:24:08.986905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:09.486236 run create_hlr_db(pid=5616): Launched 16:24:09.651856 bus /sierra_2: Setting Powered False 16:24:10.713169 run create_hlr_db(pid=5616): Terminated: ok {rc=0} 16:24:11.149751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5619): Launched 16:24:11.461351 run osmo-hlr_10.42.42.2(pid=5620): Launched 16:24:11.580793 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:12.118768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5622): Launched 16:24:12.432644 run osmo-stp_10.42.42.5(pid=5623): Launched 16:24:12.551415 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:13.112608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5625): Launched 16:24:13.422875 run osmo-msc_10.42.42.6(pid=5626): Launched 16:24:13.600273 run osmo-stp_10.42.42.5(pid=5623): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5623)] 16:24:13.730805 run osmo-stp_10.42.42.5(pid=5623): stdout: | (launched: 2022-12-13_16:24:12.374915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:13.861698 run osmo-stp_10.42.42.5(pid=5623): stderr: | [0;m[38;5;43m20221213162412548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162412548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162412548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162412549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162412549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162412549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162412549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:13.990498 run osmo-stp_10.42.42.5(pid=5623): stdout: | (launched: 2022-12-13_16:24:12.374915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:14.113107 run osmo-stp_10.42.42.5(pid=5623): stderr: | [0;m[38;5;43m20221213162412548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162412548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162412548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162412549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162412549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162412549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162412549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:14.260325 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5623): Process ended prematurely: osmo-stp_10.42.42.5(pid=5623) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5623)] [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:24:14.269508 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:24:14.296005 run osmo-hlr_10.42.42.2(pid=5620): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5620)] 16:24:14.343469 run osmo-hlr_10.42.42.2(pid=5620): stdout: | (launched: 2022-12-13_16:24:11.403711) 16:24:14.392630 run osmo-hlr_10.42.42.2(pid=5620): stderr: | [0;m[1;31m20221213162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162411593 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162411602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162411602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162411602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:14.461257 run osmo-msc_10.42.42.6(pid=5626): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5626)] 16:24:14.508752 run osmo-msc_10.42.42.6(pid=5626): stdout: | (launched: 2022-12-13_16:24:13.365566) 16:24:14.558052 run osmo-msc_10.42.42.6(pid=5626): stderr: | [0;m[38;5;43m20221213162413637 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162413637 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc6f95bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162413637 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162413637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162413637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162413638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162413639 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162413640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162413640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162413640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:14.608059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5619): Terminating (SIGTERM) 16:24:14.647863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5622): Terminating (SIGTERM) 16:24:14.687473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5625): Terminating (SIGTERM) 16:24:14.727232 --- ParallelTerminationStrategy: PID 5619 died... 16:24:14.746236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5619): Terminated: ok {rc=0} 16:24:14.790055 --- ParallelTerminationStrategy: PID 5622 died... 16:24:14.808499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5622): Terminated: ok {rc=0} 16:24:14.852202 --- ParallelTerminationStrategy: PID 5625 died... 16:24:14.870881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5625): Terminated: ok {rc=0} 16:24:14.954854 bus /sierra_3: Setting Powered False 16:24:16.070128 bus /sierra_3: Setting Powered False 16:24:17.200868 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:24:18.355676 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:18.368129 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:24:18.441679 tst mo_mt_call_osmux.py: using LAC 34817 16:24:18.567729 tst mo_mt_call_osmux.py: using RAC 137 16:24:18.693304 tst mo_mt_call_osmux.py: using CellId 34817 16:24:18.817372 tst mo_mt_call_osmux.py: using BVCI 34818 16:24:18.931535 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:18.942667 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:18.953709 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:18.964601 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:18.976181 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:24:18.987903 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:24:19.112041 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:24:19.238554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:19.756318 run create_hlr_db(pid=5628): Launched 16:24:19.884449 bus /sierra_2: Setting Powered False 16:24:20.949667 run create_hlr_db(pid=5628): Terminated: ok {rc=0} 16:24:21.413759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5630): Launched 16:24:21.750726 run osmo-hlr_10.42.42.2(pid=5631): Launched 16:24:21.880778 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:22.456360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5633): Launched 16:24:22.792292 run osmo-stp_10.42.42.5(pid=5634): Launched 16:24:22.920416 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:23.521714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5636): Launched 16:24:23.856560 run osmo-msc_10.42.42.6(pid=5637): Launched 16:24:24.043024 run osmo-stp_10.42.42.5(pid=5634): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5634)] 16:24:24.183298 run osmo-stp_10.42.42.5(pid=5634): stdout: | (launched: 2022-12-13_16:24:22.731397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:24.323968 run osmo-stp_10.42.42.5(pid=5634): stderr: | [0;m[38;5;43m20221213162422922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162422922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162422923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162422923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162422924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162422924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162422924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:24.462918 run osmo-stp_10.42.42.5(pid=5634): stdout: | (launched: 2022-12-13_16:24:22.731397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:24.594863 run osmo-stp_10.42.42.5(pid=5634): stderr: | [0;m[38;5;43m20221213162422922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162422922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162422923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162422923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162422924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162422924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162422924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:24.753102 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5634): Process ended prematurely: osmo-stp_10.42.42.5(pid=5634) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5634)] [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:24:24.762951 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:24:24.791223 run osmo-hlr_10.42.42.2(pid=5631): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5631)] 16:24:24.842372 run osmo-hlr_10.42.42.2(pid=5631): stdout: | (launched: 2022-12-13_16:24:21.689846) 16:24:24.894617 run osmo-hlr_10.42.42.2(pid=5631): stderr: | [0;m[1;31m20221213162421888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162421888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162421889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162421889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162421889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162421889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162421901 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162421910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162421910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162421910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:24.967835 run osmo-msc_10.42.42.6(pid=5637): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5637)] 16:24:25.018285 run osmo-msc_10.42.42.6(pid=5637): stdout: | (launched: 2022-12-13_16:24:23.795702) 16:24:25.070790 run osmo-msc_10.42.42.6(pid=5637): stderr: | [0;m[38;5;43m20221213162424118 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162424118 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c4c4b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162424118 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162424118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162424119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162424119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162424120 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162424121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162424121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162424121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:25.123463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5630): Terminating (SIGTERM) 16:24:25.165807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5633): Terminating (SIGTERM) 16:24:25.208355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5636): Terminating (SIGTERM) 16:24:25.251338 --- ParallelTerminationStrategy: PID 5630 died... 16:24:25.271888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5630): Terminated: ok {rc=0} 16:24:25.318888 --- ParallelTerminationStrategy: PID 5633 died... 16:24:25.338902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5633): Terminated: ok {rc=0} 16:24:25.385417 --- ParallelTerminationStrategy: PID 5636 died... 16:24:25.405375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5636): Terminated: ok {rc=0} 16:24:25.494090 bus /sierra_3: Setting Powered False 16:24:26.592210 bus /sierra_3: Setting Powered False 16:24:27.707640 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:24:28.960637 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:28.967176 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:24:29.000573 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:24:29.027574 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:24:29.078812 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:24:29.111974 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:24:29.138621 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:24:29.691498 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:24:29.741222 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:29.752567 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:24:29.822276 tst mo_mt_call.py: using LAC 34818 16:24:29.944816 tst mo_mt_call.py: using RAC 138 16:24:30.068228 tst mo_mt_call.py: using CellId 34818 16:24:30.191112 tst mo_mt_call.py: using BVCI 34819 16:24:30.305454 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:30.316552 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:30.327541 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:30.338545 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:30.349668 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:30.360591 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:24:30.477377 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:24:30.595236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:31.135155 run create_hlr_db(pid=5642): Launched 16:24:31.300432 bus /sierra_2: Setting Powered False 16:24:32.362659 run create_hlr_db(pid=5642): Terminated: ok {rc=0} 16:24:32.816867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5644): Launched 16:24:33.152653 run osmo-hlr_10.42.42.2(pid=5645): Launched 16:24:33.280399 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:33.857551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5647): Launched 16:24:34.193309 run osmo-stp_10.42.42.5(pid=5648): Launched 16:24:34.321321 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:34.923398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5650): Launched 16:24:35.258451 run osmo-msc_10.42.42.6(pid=5651): Launched 16:24:35.448089 run osmo-stp_10.42.42.5(pid=5648): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5648)] 16:24:35.588003 run osmo-stp_10.42.42.5(pid=5648): stdout: | (launched: 2022-12-13_16:24:34.131847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:35.728869 run osmo-stp_10.42.42.5(pid=5648): stderr: | [0;m[38;5;43m20221213162434325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162434325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162434326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162434326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162434327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162434327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162434327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:35.867684 run osmo-stp_10.42.42.5(pid=5648): stdout: | (launched: 2022-12-13_16:24:34.131847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:35.999898 run osmo-stp_10.42.42.5(pid=5648): stderr: | [0;m[38;5;43m20221213162434325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162434325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162434326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162434326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162434327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162434327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162434327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:36.158484 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5648): Process ended prematurely: osmo-stp_10.42.42.5(pid=5648) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5648)] [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:24:36.168334 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:24:36.196360 run osmo-hlr_10.42.42.2(pid=5645): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5645)] 16:24:36.247555 run osmo-hlr_10.42.42.2(pid=5645): stdout: | (launched: 2022-12-13_16:24:33.091216) 16:24:36.299929 run osmo-hlr_10.42.42.2(pid=5645): stderr: | [0;m[1;31m20221213162433291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162433291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162433291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162433291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162433291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162433291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162433303 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162433312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162433312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162433312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:36.373282 run osmo-msc_10.42.42.6(pid=5651): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5651)] 16:24:36.423660 run osmo-msc_10.42.42.6(pid=5651): stdout: | (launched: 2022-12-13_16:24:35.197557) 16:24:36.476378 run osmo-msc_10.42.42.6(pid=5651): stderr: | [0;m[38;5;43m20221213162435520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162435521 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f63daf9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162435521 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162435521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162435521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162435521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162435523 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162435523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162435524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162435524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:36.528754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5644): Terminating (SIGTERM) 16:24:36.571249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5647): Terminating (SIGTERM) 16:24:36.613668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5650): Terminating (SIGTERM) 16:24:36.656038 --- ParallelTerminationStrategy: PID 5644 died... 16:24:36.676475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5644): Terminated: ok {rc=0} 16:24:36.723058 --- ParallelTerminationStrategy: PID 5647 died... 16:24:36.742884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5647): Terminated: ok {rc=0} 16:24:36.789433 --- ParallelTerminationStrategy: PID 5650 died... 16:24:36.809405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5650): Terminated: ok {rc=0} 16:24:36.898111 bus /sierra_3: Setting Powered False 16:24:37.998872 bus /sierra_3: Setting Powered False 16:24:39.120396 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:24:40.269268 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:40.281479 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:24:40.352310 tst mo_mt_call_osmux.py: using LAC 34819 16:24:40.474517 tst mo_mt_call_osmux.py: using RAC 139 16:24:40.607194 tst mo_mt_call_osmux.py: using CellId 34819 16:24:40.739086 tst mo_mt_call_osmux.py: using BVCI 34820 16:24:40.862460 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:40.874189 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:40.885722 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:40.897222 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:40.909333 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:24:40.921218 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:24:41.039594 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:24:41.163529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:41.644568 run create_hlr_db(pid=5653): Launched 16:24:41.772187 bus /sierra_2: Setting Powered False 16:24:42.834219 run create_hlr_db(pid=5653): Terminated: ok {rc=0} 16:24:43.266873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5655): Launched 16:24:43.578861 run osmo-hlr_10.42.42.2(pid=5656): Launched 16:24:43.697900 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:44.247926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5658): Launched 16:24:44.559500 run osmo-stp_10.42.42.5(pid=5659): Launched 16:24:44.679956 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:45.243803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5661): Launched 16:24:45.556553 run osmo-msc_10.42.42.6(pid=5662): Launched 16:24:45.735688 run osmo-stp_10.42.42.5(pid=5659): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5659)] 16:24:45.917947 run osmo-stp_10.42.42.5(pid=5659): stdout: | (launched: 2022-12-13_16:24:44.501821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:46.084591 run osmo-stp_10.42.42.5(pid=5659): stderr: | [0;m[38;5;43m20221213162444672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162444673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162444673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162444673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162444674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162444674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162444674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:46.229451 run osmo-stp_10.42.42.5(pid=5659): stdout: | (launched: 2022-12-13_16:24:44.501821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:46.368166 run osmo-stp_10.42.42.5(pid=5659): stderr: | [0;m[38;5;43m20221213162444672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162444673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162444673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162444673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162444674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162444674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162444674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:46.533319 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5659): Process ended prematurely: osmo-stp_10.42.42.5(pid=5659) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5659)] [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:24:46.544172 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:24:46.573536 run osmo-hlr_10.42.42.2(pid=5656): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5656)] 16:24:46.629239 run osmo-hlr_10.42.42.2(pid=5656): stdout: | (launched: 2022-12-13_16:24:43.520771) 16:24:46.685642 run osmo-hlr_10.42.42.2(pid=5656): stderr: | [0;m[1;31m20221213162443699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162443699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162443699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162443699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162443699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162443699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162443711 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162443719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162443719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162443720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:46.762616 run osmo-msc_10.42.42.6(pid=5662): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5662)] 16:24:46.814810 run osmo-msc_10.42.42.6(pid=5662): stdout: | (launched: 2022-12-13_16:24:45.499018) 16:24:46.871001 run osmo-msc_10.42.42.6(pid=5662): stderr: | [0;m[38;5;43m20221213162445771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162445771 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe44d6ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162445771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162445771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162445771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162445772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162445773 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162445774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162445774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162445774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:46.926804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5655): Terminating (SIGTERM) 16:24:46.971673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5658): Terminating (SIGTERM) 16:24:47.019566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5661): Terminating (SIGTERM) 16:24:47.067383 --- ParallelTerminationStrategy: PID 5655 died... 16:24:47.090778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5655): Terminated: ok {rc=0} 16:24:47.141520 --- ParallelTerminationStrategy: PID 5658 died... 16:24:47.162962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5658): Terminated: ok {rc=0} 16:24:47.212314 --- ParallelTerminationStrategy: PID 5661 died... 16:24:47.233332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5661): Terminated: ok {rc=0} 16:24:47.323393 bus /sierra_3: Setting Powered False 16:24:48.422929 bus /sierra_3: Setting Powered False 16:24:49.540940 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:24:50.800817 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:50.809827 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:24:50.845312 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:24:50.873365 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:24:50.927189 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:24:50.960783 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:24:50.987586 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:24:51.539882 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:24:51.589544 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:24:51.600646 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:24:51.668688 tst mo_mt_call.py: using LAC 34820 16:24:51.788101 tst mo_mt_call.py: using RAC 140 16:24:51.907433 tst mo_mt_call.py: using CellId 34820 16:24:52.029577 tst mo_mt_call.py: using BVCI 34821 16:24:52.143800 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:24:52.154993 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:24:52.166125 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:24:52.177160 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:24:52.188154 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:24:52.199116 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:24:52.319199 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:24:52.445631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:52.963282 run create_hlr_db(pid=5667): Launched 16:24:53.091444 bus /sierra_2: Setting Powered False 16:24:54.156590 run create_hlr_db(pid=5667): Terminated: ok {rc=0} 16:24:54.602174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5669): Launched 16:24:54.915817 run osmo-hlr_10.42.42.2(pid=5670): Launched 16:24:55.036205 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:55.587961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5672): Launched 16:24:55.900409 run osmo-stp_10.42.42.5(pid=5673): Launched 16:24:56.020071 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:56.584402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5675): Launched 16:24:56.896834 run osmo-msc_10.42.42.6(pid=5676): Launched 16:24:57.071521 run osmo-stp_10.42.42.5(pid=5673): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5673)] 16:24:57.202151 run osmo-stp_10.42.42.5(pid=5673): stdout: | (launched: 2022-12-13_16:24:55.842503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:57.332587 run osmo-stp_10.42.42.5(pid=5673): stderr: | [0;m[38;5;43m20221213162456013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162456014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162456014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162456014 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162456015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162456015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162456015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:57.461902 run osmo-stp_10.42.42.5(pid=5673): stdout: | (launched: 2022-12-13_16:24:55.842503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:57.584791 run osmo-stp_10.42.42.5(pid=5673): stderr: | [0;m[38;5;43m20221213162456013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162456014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162456014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162456014 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162456015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162456015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162456015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:57.732482 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5673): Process ended prematurely: osmo-stp_10.42.42.5(pid=5673) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5673)] [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:24:57.741572 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:24:57.768165 run osmo-hlr_10.42.42.2(pid=5670): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5670)] 16:24:57.816005 run osmo-hlr_10.42.42.2(pid=5670): stdout: | (launched: 2022-12-13_16:24:54.858312) 16:24:57.865590 run osmo-hlr_10.42.42.2(pid=5670): stderr: | [0;m[1;31m20221213162455032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162455032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162455032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162455032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162455032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162455032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162455046 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162455056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162455056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162455056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:57.934940 run osmo-msc_10.42.42.6(pid=5676): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5676)] 16:24:57.982771 run osmo-msc_10.42.42.6(pid=5676): stdout: | (launched: 2022-12-13_16:24:56.839090) 16:24:58.032178 run osmo-msc_10.42.42.6(pid=5676): stderr: | [0;m[38;5;43m20221213162457113 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162457113 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbff0c69c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162457113 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162457113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162457114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162457114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162457115 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162457116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162457116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162457116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:58.082008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5669): Terminating (SIGTERM) 16:24:58.121846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5672): Terminating (SIGTERM) 16:24:58.161744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5675): Terminating (SIGTERM) 16:24:58.201565 --- ParallelTerminationStrategy: PID 5669 died... 16:24:58.220651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5669): Terminated: ok {rc=0} 16:24:58.264493 --- ParallelTerminationStrategy: PID 5672 died... 16:24:58.283000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5672): Terminated: ok {rc=0} 16:24:58.326787 --- ParallelTerminationStrategy: PID 5675 died... 16:24:58.345392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5675): Terminated: ok {rc=0} 16:24:58.429373 bus /sierra_3: Setting Powered False 16:24:59.527150 bus /sierra_3: Setting Powered False 16:25:00.644159 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:25:01.821233 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:01.833873 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:25:01.920689 tst mo_mt_call_osmux.py: using LAC 34821 16:25:02.050405 tst mo_mt_call_osmux.py: using RAC 141 16:25:02.221609 tst mo_mt_call_osmux.py: using CellId 34821 16:25:02.354419 tst mo_mt_call_osmux.py: using BVCI 34822 16:25:02.476019 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:02.487932 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:02.499584 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:02.511257 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:02.523473 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:02.535445 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:25:02.659181 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:25:02.778902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:03.262668 run create_hlr_db(pid=5681): Launched 16:25:03.389242 bus /sierra_2: Setting Powered False 16:25:04.450939 run create_hlr_db(pid=5681): Terminated: ok {rc=0} 16:25:04.906387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5683): Launched 16:25:05.242007 run osmo-hlr_10.42.42.2(pid=5684): Launched 16:25:05.369993 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:05.945484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5686): Launched 16:25:06.279679 run osmo-stp_10.42.42.5(pid=5687): Launched 16:25:06.409130 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:07.011595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5689): Launched 16:25:07.345187 run osmo-msc_10.42.42.6(pid=5690): Launched 16:25:07.531410 run osmo-stp_10.42.42.5(pid=5687): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5687)] 16:25:07.671854 run osmo-stp_10.42.42.5(pid=5687): stdout: | (launched: 2022-12-13_16:25:06.217973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:07.813847 run osmo-stp_10.42.42.5(pid=5687): stderr: | [0;m[38;5;43m20221213162506409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162506410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162506410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162506410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:07.953440 run osmo-stp_10.42.42.5(pid=5687): stdout: | (launched: 2022-12-13_16:25:06.217973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:08.085667 run osmo-stp_10.42.42.5(pid=5687): stderr: | [0;m[38;5;43m20221213162506409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162506410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162506410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162506410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:08.244038 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5687): Process ended prematurely: osmo-stp_10.42.42.5(pid=5687) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5687)] [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:25:08.253999 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:25:08.282075 run osmo-hlr_10.42.42.2(pid=5684): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5684)] 16:25:08.333272 run osmo-hlr_10.42.42.2(pid=5684): stdout: | (launched: 2022-12-13_16:25:05.180250) 16:25:08.385713 run osmo-hlr_10.42.42.2(pid=5684): stderr: | [0;m[1;31m20221213162505379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162505379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162505379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162505379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162505379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162505379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162505390 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162505400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162505400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162505400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:08.459102 run osmo-msc_10.42.42.6(pid=5690): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5690)] 16:25:08.509215 run osmo-msc_10.42.42.6(pid=5690): stdout: | (launched: 2022-12-13_16:25:07.284054) 16:25:08.561610 run osmo-msc_10.42.42.6(pid=5690): stderr: | [0;m[38;5;43m20221213162507607 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162507607 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3f7763ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162507607 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162507607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162507607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162507607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162507609 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162507610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162507610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162507610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:08.614270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5683): Terminating (SIGTERM) 16:25:08.656633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5686): Terminating (SIGTERM) 16:25:08.699458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5689): Terminating (SIGTERM) 16:25:08.742590 --- ParallelTerminationStrategy: PID 5683 died... 16:25:08.763129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5683): Terminated: ok {rc=0} 16:25:08.809940 --- ParallelTerminationStrategy: PID 5686 died... 16:25:08.829775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5686): Terminated: ok {rc=0} 16:25:08.876232 --- ParallelTerminationStrategy: PID 5689 died... 16:25:08.896280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5689): Terminated: ok {rc=0} 16:25:08.985491 bus /sierra_3: Setting Powered False 16:25:10.084638 bus /sierra_3: Setting Powered False 16:25:11.202024 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:25:12.461223 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:25:12.468462 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:25:12.503318 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:25:12.531824 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:25:12.584839 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:25:12.620053 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:25:12.648849 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:25:13.200746 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:25:13.255321 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:13.267009 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:25:13.339828 tst mo_mt_call.py: using LAC 34822 16:25:13.471317 tst mo_mt_call.py: using RAC 142 16:25:13.600871 tst mo_mt_call.py: using CellId 34822 16:25:13.732795 tst mo_mt_call.py: using BVCI 34823 16:25:13.846655 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:13.858404 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:13.869712 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:13.880887 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:13.892294 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:13.903450 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:25:14.028758 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:25:14.151769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:14.666489 run create_hlr_db(pid=5696): Launched 16:25:14.794054 bus /sierra_2: Setting Powered False 16:25:15.861153 run create_hlr_db(pid=5696): Terminated: ok {rc=0} 16:25:16.336373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5698): Launched 16:25:16.669304 run osmo-hlr_10.42.42.2(pid=5699): Launched 16:25:16.910848 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:17.560914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5701): Launched 16:25:17.893693 run osmo-stp_10.42.42.5(pid=5702): Launched 16:25:18.022961 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:18.622847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5704): Launched 16:25:18.955254 run osmo-msc_10.42.42.6(pid=5705): Launched 16:25:19.143399 run osmo-stp_10.42.42.5(pid=5702): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5702)] 16:25:19.282822 run osmo-stp_10.42.42.5(pid=5702): stdout: | (launched: 2022-12-13_16:25:17.832333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:19.423353 run osmo-stp_10.42.42.5(pid=5702): stderr: | [0;m[38;5;43m20221213162518024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162518024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162518025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162518025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162518025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162518025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162518026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:19.561921 run osmo-stp_10.42.42.5(pid=5702): stdout: | (launched: 2022-12-13_16:25:17.832333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:19.693914 run osmo-stp_10.42.42.5(pid=5702): stderr: | [0;m[38;5;43m20221213162518024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162518024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162518025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162518025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162518025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162518025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162518026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:19.851456 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5702): Process ended prematurely: osmo-stp_10.42.42.5(pid=5702) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5702)] [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:25:19.861220 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 16:25:19.889355 run osmo-hlr_10.42.42.2(pid=5699): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5699)] 16:25:19.940597 run osmo-hlr_10.42.42.2(pid=5699): stdout: | (launched: 2022-12-13_16:25:16.610782) 16:25:19.993391 run osmo-hlr_10.42.42.2(pid=5699): stderr: | [0;m[1;31m20221213162516896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162516896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162516897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162516897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162516897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162516897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162516920 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162516928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162516928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162516928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:20.066744 run osmo-msc_10.42.42.6(pid=5705): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5705)] 16:25:20.117273 run osmo-msc_10.42.42.6(pid=5705): stdout: | (launched: 2022-12-13_16:25:18.894895) 16:25:20.169730 run osmo-msc_10.42.42.6(pid=5705): stderr: | [0;m[38;5;43m20221213162519216 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162519216 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f00de4bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162519216 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162519216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162519216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162519216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162519218 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162519219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162519219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162519219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:20.222460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5698): Terminating (SIGTERM) 16:25:20.264703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5701): Terminating (SIGTERM) 16:25:20.307704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5704): Terminating (SIGTERM) 16:25:20.350382 --- ParallelTerminationStrategy: PID 5698 died... 16:25:20.370823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5698): Terminated: ok {rc=0} 16:25:20.417375 --- ParallelTerminationStrategy: PID 5701 died... 16:25:20.437283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5701): Terminated: ok {rc=0} 16:25:20.483795 --- ParallelTerminationStrategy: PID 5704 died... 16:25:20.503666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5704): Terminated: ok {rc=0} 16:25:20.593027 bus /sierra_3: Setting Powered False 16:25:21.691768 bus /sierra_3: Setting Powered False 16:25:22.808324 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:25:23.957324 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:23.970020 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:25:24.047443 tst mo_mt_call_osmux.py: using LAC 34823 16:25:24.177983 tst mo_mt_call_osmux.py: using RAC 143 16:25:24.298663 tst mo_mt_call_osmux.py: using CellId 34823 16:25:24.428298 tst mo_mt_call_osmux.py: using BVCI 34824 16:25:24.548746 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:24.560649 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:24.572362 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:24.584265 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:24.596248 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:25:24.608195 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:25:24.730659 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:25:24.850256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:25.333255 run create_hlr_db(pid=5707): Launched 16:25:25.461961 bus /sierra_2: Setting Powered False 16:25:26.523297 run create_hlr_db(pid=5707): Terminated: ok {rc=0} 16:25:26.957271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5709): Launched 16:25:27.270340 run osmo-hlr_10.42.42.2(pid=5710): Launched 16:25:27.388881 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:27.937933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5712): Launched 16:25:28.249670 run osmo-stp_10.42.42.5(pid=5713): Launched 16:25:28.367850 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:28.928447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5715): Launched 16:25:29.241833 run osmo-msc_10.42.42.6(pid=5716): Launched 16:25:29.416328 run osmo-stp_10.42.42.5(pid=5713): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5713)] 16:25:29.547169 run osmo-stp_10.42.42.5(pid=5713): stdout: | (launched: 2022-12-13_16:25:28.191974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:29.678966 run osmo-stp_10.42.42.5(pid=5713): stderr: | [0;m[38;5;43m20221213162528363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162528363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162528363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162528364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162528364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162528364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162528364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:29.808647 run osmo-stp_10.42.42.5(pid=5713): stdout: | (launched: 2022-12-13_16:25:28.191974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:29.932080 run osmo-stp_10.42.42.5(pid=5713): stderr: | [0;m[38;5;43m20221213162528363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162528363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162528363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162528364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162528364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162528364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162528364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:30.080107 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5713): Process ended prematurely: osmo-stp_10.42.42.5(pid=5713) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5713)] [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:25:30.089544 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:25:30.116412 run osmo-hlr_10.42.42.2(pid=5710): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5710)] 16:25:30.164441 run osmo-hlr_10.42.42.2(pid=5710): stdout: | (launched: 2022-12-13_16:25:27.212585) 16:25:30.214110 run osmo-hlr_10.42.42.2(pid=5710): stderr: | [0;m[1;31m20221213162527391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162527391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162527391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162527392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162527392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162527392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162527404 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162527415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162527415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162527415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:30.283372 run osmo-msc_10.42.42.6(pid=5716): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5716)] 16:25:30.331177 run osmo-msc_10.42.42.6(pid=5716): stdout: | (launched: 2022-12-13_16:25:29.183144) 16:25:30.381106 run osmo-msc_10.42.42.6(pid=5716): stderr: | [0;m[38;5;43m20221213162529457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162529457 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f207dd05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162529457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162529457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162529457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162529458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162529459 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162529460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162529460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162529460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:30.430954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5709): Terminating (SIGTERM) 16:25:30.470901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5712): Terminating (SIGTERM) 16:25:30.510709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5715): Terminating (SIGTERM) 16:25:30.550510 --- ParallelTerminationStrategy: PID 5709 died... 16:25:30.569969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5709): Terminated: ok {rc=0} 16:25:30.614360 --- ParallelTerminationStrategy: PID 5712 died... 16:25:30.633169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5712): Terminated: ok {rc=0} 16:25:30.677114 --- ParallelTerminationStrategy: PID 5715 died... 16:25:30.695913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5715): Terminated: ok {rc=0} 16:25:30.780023 bus /sierra_3: Setting Powered False 16:25:31.877093 bus /sierra_3: Setting Powered False 16:25:32.992241 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:25:34.252736 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:25:34.259992 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:25:34.294182 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:25:34.322921 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:25:34.376817 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:25:34.411289 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:25:34.439124 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:25:34.990120 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:25:35.043666 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:35.055583 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:25:35.128512 tst mo_mt_call.py: using LAC 34824 16:25:35.262936 tst mo_mt_call.py: using RAC 144 16:25:35.386240 tst mo_mt_call.py: using CellId 34824 16:25:35.510865 tst mo_mt_call.py: using BVCI 34825 16:25:35.625374 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:35.636338 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:35.647529 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:35.658514 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:35.669553 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:35.680455 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:25:35.803954 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:25:35.923349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:36.405724 run create_hlr_db(pid=5721): Launched 16:25:36.532755 bus /sierra_2: Setting Powered False 16:25:37.595276 run create_hlr_db(pid=5721): Terminated: ok {rc=0} 16:25:38.027626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5723): Launched 16:25:38.339465 run osmo-hlr_10.42.42.2(pid=5724): Launched 16:25:38.457365 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:38.989907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5726): Launched 16:25:39.302612 run osmo-stp_10.42.42.5(pid=5727): Launched 16:25:39.423840 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:39.986921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5729): Launched 16:25:40.299737 run osmo-msc_10.42.42.6(pid=5730): Launched 16:25:40.474897 run osmo-stp_10.42.42.5(pid=5727): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5727)] 16:25:40.606168 run osmo-stp_10.42.42.5(pid=5727): stdout: | (launched: 2022-12-13_16:25:39.244462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:40.737701 run osmo-stp_10.42.42.5(pid=5727): stderr: | [0;m[38;5;43m20221213162539415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162539415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162539416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162539416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162539416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162539417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162539417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:40.866712 run osmo-stp_10.42.42.5(pid=5727): stdout: | (launched: 2022-12-13_16:25:39.244462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:40.989697 run osmo-stp_10.42.42.5(pid=5727): stderr: | [0;m[38;5;43m20221213162539415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162539415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162539416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162539416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162539416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162539417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162539417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:41.137453 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5727): Process ended prematurely: osmo-stp_10.42.42.5(pid=5727) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5727)] [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:25:41.146452 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:25:41.172941 run osmo-hlr_10.42.42.2(pid=5724): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5724)] 16:25:41.221425 run osmo-hlr_10.42.42.2(pid=5724): stdout: | (launched: 2022-12-13_16:25:38.281989) 16:25:41.270914 run osmo-hlr_10.42.42.2(pid=5724): stderr: | [0;m[1;31m20221213162538456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162538456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162538456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162538456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162538456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162538456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162538473 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162538485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162538485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162538485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:41.340860 run osmo-msc_10.42.42.6(pid=5730): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5730)] 16:25:41.388674 run osmo-msc_10.42.42.6(pid=5730): stdout: | (launched: 2022-12-13_16:25:40.242384) 16:25:41.438111 run osmo-msc_10.42.42.6(pid=5730): stderr: | [0;m[38;5;43m20221213162540517 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162540517 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7f814c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162540517 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162540517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162540517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162540518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162540519 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162540520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162540520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162540520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:41.488077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5723): Terminating (SIGTERM) 16:25:41.527733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5726): Terminating (SIGTERM) 16:25:41.567084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5729): Terminating (SIGTERM) 16:25:41.606758 --- ParallelTerminationStrategy: PID 5723 died... 16:25:41.625866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5723): Terminated: ok {rc=0} 16:25:41.669795 --- ParallelTerminationStrategy: PID 5726 died... 16:25:41.688266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5726): Terminated: ok {rc=0} 16:25:41.732188 --- ParallelTerminationStrategy: PID 5729 died... 16:25:41.750843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5729): Terminated: ok {rc=0} 16:25:41.834878 bus /sierra_3: Setting Powered False 16:25:42.934317 bus /sierra_3: Setting Powered False 16:25:44.054092 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:25:45.202079 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:45.214156 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:25:45.284850 tst mo_mt_call_osmux.py: using LAC 34825 16:25:45.406812 tst mo_mt_call_osmux.py: using RAC 145 16:25:45.530462 tst mo_mt_call_osmux.py: using CellId 34825 16:25:45.653575 tst mo_mt_call_osmux.py: using BVCI 34826 16:25:45.776206 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:45.788074 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:45.799782 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:45.811553 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:45.823487 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:25:45.838325 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:25:45.978863 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:25:46.120306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:46.652857 run create_hlr_db(pid=5732): Launched 16:25:46.813235 bus /sierra_2: Setting Powered False 16:25:47.878017 run create_hlr_db(pid=5732): Terminated: ok {rc=0} 16:25:48.322917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5734): Launched 16:25:48.633717 run osmo-hlr_10.42.42.2(pid=5735): Launched 16:25:48.752799 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:49.299630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5737): Launched 16:25:49.612538 run osmo-stp_10.42.42.5(pid=5738): Launched 16:25:49.733241 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:50.326745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5740): Launched 16:25:50.660704 run osmo-msc_10.42.42.6(pid=5741): Launched 16:25:50.847179 run osmo-stp_10.42.42.5(pid=5738): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5738)] 16:25:50.990046 run osmo-stp_10.42.42.5(pid=5738): stdout: | (launched: 2022-12-13_16:25:49.554629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:51.129691 run osmo-stp_10.42.42.5(pid=5738): stderr: | [0;m[38;5;43m20221213162549725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162549726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162549726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162549726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162549727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162549727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162549727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:51.267784 run osmo-stp_10.42.42.5(pid=5738): stdout: | (launched: 2022-12-13_16:25:49.554629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:51.399482 run osmo-stp_10.42.42.5(pid=5738): stderr: | [0;m[38;5;43m20221213162549725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162549726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162549726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162549726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162549727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162549727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162549727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:51.557391 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5738): Process ended prematurely: osmo-stp_10.42.42.5(pid=5738) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5738)] [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:25:51.567266 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:25:51.595290 run osmo-hlr_10.42.42.2(pid=5735): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5735)] 16:25:51.645963 run osmo-hlr_10.42.42.2(pid=5735): stdout: | (launched: 2022-12-13_16:25:48.576632) 16:25:51.698374 run osmo-hlr_10.42.42.2(pid=5735): stderr: | [0;m[1;31m20221213162548752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162548752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162548752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162548752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162548752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162548752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162548765 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162548773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162548774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162548774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:51.771473 run osmo-msc_10.42.42.6(pid=5741): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5741)] 16:25:51.821562 run osmo-msc_10.42.42.6(pid=5741): stdout: | (launched: 2022-12-13_16:25:50.599804) 16:25:51.874438 run osmo-msc_10.42.42.6(pid=5741): stderr: | [0;m[38;5;43m20221213162550923 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162550923 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff35e1dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162550923 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162550924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162550924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162550924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162550926 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162550926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162550926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162550926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:51.927889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5734): Terminating (SIGTERM) 16:25:51.970516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5737): Terminating (SIGTERM) 16:25:52.012774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5740): Terminating (SIGTERM) 16:25:52.055872 --- ParallelTerminationStrategy: PID 5734 died... 16:25:52.076746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5734): Terminated: ok {rc=0} 16:25:52.124186 --- ParallelTerminationStrategy: PID 5737 died... 16:25:52.144339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5737): Terminated: ok {rc=0} 16:25:52.190838 --- ParallelTerminationStrategy: PID 5740 died... 16:25:52.210721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5740): Terminated: ok {rc=0} 16:25:52.298550 bus /sierra_3: Setting Powered False 16:25:53.397591 bus /sierra_3: Setting Powered False 16:25:54.513907 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:25:55.768218 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:25:55.774766 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:25:55.807658 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:25:55.834601 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:25:55.886366 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:25:55.921178 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:25:55.949630 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:25:56.498556 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:25:56.548249 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:25:56.559589 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:25:56.629641 tst mo_mt_call.py: using LAC 34826 16:25:56.751538 tst mo_mt_call.py: using RAC 146 16:25:56.874856 tst mo_mt_call.py: using CellId 34826 16:25:56.997325 tst mo_mt_call.py: using BVCI 34827 16:25:57.109615 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:25:57.120767 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:25:57.131910 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:25:57.142943 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:25:57.154268 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:25:57.165524 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:25:57.288363 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:25:57.408620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:57.892345 run create_hlr_db(pid=5750): Launched 16:25:58.020599 bus /sierra_2: Setting Powered False 16:25:59.085736 run create_hlr_db(pid=5750): Terminated: ok {rc=0} 16:25:59.551350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5752): Launched 16:25:59.887785 run osmo-hlr_10.42.42.2(pid=5753): Launched 16:26:00.016877 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:00.591353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5755): Launched 16:26:00.933748 run osmo-stp_10.42.42.5(pid=5756): Launched 16:26:01.133720 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:01.946538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5758): Launched 16:26:02.297795 run osmo-msc_10.42.42.6(pid=5759): Launched 16:26:02.580869 run osmo-stp_10.42.42.5(pid=5756): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5756)] 16:26:02.722723 run osmo-stp_10.42.42.5(pid=5756): stdout: | (launched: 2022-12-13_16:26:00.867194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:02.865842 run osmo-stp_10.42.42.5(pid=5756): stderr: | [0;m[38;5;43m20221213162601232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162601232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162601232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162601232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162601234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162601234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162601234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:03.006943 run osmo-stp_10.42.42.5(pid=5756): stdout: | (launched: 2022-12-13_16:26:00.867194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:03.139554 run osmo-stp_10.42.42.5(pid=5756): stderr: | [0;m[38;5;43m20221213162601232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162601232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162601232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162601232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162601234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162601234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162601234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:03.297681 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5756): Process ended prematurely: osmo-stp_10.42.42.5(pid=5756) [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5756)] [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:26:03.307583 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 16:26:03.336092 run osmo-hlr_10.42.42.2(pid=5753): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5753)] 16:26:03.387319 run osmo-hlr_10.42.42.2(pid=5753): stdout: | (launched: 2022-12-13_16:25:59.826696) 16:26:03.440001 run osmo-hlr_10.42.42.2(pid=5753): stderr: | [0;m[1;31m20221213162600024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162600024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162600024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162600024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162600024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162600024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162600037 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162600046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162600046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162600046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:03.513907 run osmo-msc_10.42.42.6(pid=5759): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5759)] 16:26:03.564606 run osmo-msc_10.42.42.6(pid=5759): stdout: | (launched: 2022-12-13_16:26:02.236834) 16:26:03.617970 run osmo-msc_10.42.42.6(pid=5759): stderr: | [0;m[38;5;43m20221213162602666 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162602667 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faa82a1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162602667 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162602667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162602667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162602667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162602669 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162602669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162602669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162602670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:03.670791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5752): Terminating (SIGTERM) 16:26:03.713513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5755): Terminating (SIGTERM) 16:26:03.756019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5758): Terminating (SIGTERM) 16:26:03.799386 --- ParallelTerminationStrategy: PID 5752 died... 16:26:03.820009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5752): Terminated: ok {rc=0} 16:26:03.867223 --- ParallelTerminationStrategy: PID 5755 died... 16:26:03.887412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5755): Terminated: ok {rc=0} 16:26:03.934218 --- ParallelTerminationStrategy: PID 5758 died... 16:26:03.954342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5758): Terminated: ok {rc=0} 16:26:04.043640 bus /sierra_3: Setting Powered False 16:26:05.142396 bus /sierra_3: Setting Powered False 16:26:06.262852 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:26:07.414179 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:07.426786 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:26:07.500632 tst mo_mt_call_osmux.py: using LAC 34827 16:26:07.633731 tst mo_mt_call_osmux.py: using RAC 147 16:26:07.757182 tst mo_mt_call_osmux.py: using CellId 34827 16:26:07.879868 tst mo_mt_call_osmux.py: using BVCI 34828 16:26:07.994492 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:08.005999 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:08.017447 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:08.028591 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:08.039808 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:08.051026 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:26:08.167967 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:26:08.290938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:08.806922 run create_hlr_db(pid=5761): Launched 16:26:08.936052 bus /sierra_2: Setting Powered False 16:26:10.001823 run create_hlr_db(pid=5761): Terminated: ok {rc=0} 16:26:10.447279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5763): Launched 16:26:10.761808 run osmo-hlr_10.42.42.2(pid=5764): Launched 16:26:10.881739 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:11.418329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5766): Launched 16:26:11.730579 run osmo-stp_10.42.42.5(pid=5767): Launched 16:26:11.849899 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:12.420856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5769): Launched 16:26:12.734952 run osmo-msc_10.42.42.6(pid=5770): Launched 16:26:12.913462 run osmo-stp_10.42.42.5(pid=5767): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5767)] 16:26:13.045382 run osmo-stp_10.42.42.5(pid=5767): stdout: | (launched: 2022-12-13_16:26:11.673224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:13.176632 run osmo-stp_10.42.42.5(pid=5767): stderr: | [0;m[38;5;43m20221213162611843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162611843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162611843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162611844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162611844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162611844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162611844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:13.306479 run osmo-stp_10.42.42.5(pid=5767): stdout: | (launched: 2022-12-13_16:26:11.673224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:13.429862 run osmo-stp_10.42.42.5(pid=5767): stderr: | [0;m[38;5;43m20221213162611843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162611843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162611843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162611844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162611844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162611844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162611844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:13.578204 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5767): Process ended prematurely: osmo-stp_10.42.42.5(pid=5767) [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5767)] [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:26:13.587366 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:26:13.614051 run osmo-hlr_10.42.42.2(pid=5764): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5764)] 16:26:13.661955 run osmo-hlr_10.42.42.2(pid=5764): stdout: | (launched: 2022-12-13_16:26:10.703928) 16:26:13.711445 run osmo-hlr_10.42.42.2(pid=5764): stderr: | [0;m[1;31m20221213162610881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162610881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162610881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162610881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162610881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162610881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162610893 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162610902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162610902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162610902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:13.780877 run osmo-msc_10.42.42.6(pid=5770): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5770)] 16:26:13.828635 run osmo-msc_10.42.42.6(pid=5770): stdout: | (launched: 2022-12-13_16:26:12.677054) 16:26:13.877995 run osmo-msc_10.42.42.6(pid=5770): stderr: | [0;m[38;5;43m20221213162612948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162612949 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0f0cad6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162612949 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162612949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162612949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162612949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162612951 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162612951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162612952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162612952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:13.927737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5763): Terminating (SIGTERM) 16:26:13.967537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5766): Terminating (SIGTERM) 16:26:14.007398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5769): Terminating (SIGTERM) 16:26:14.047571 --- ParallelTerminationStrategy: PID 5763 died... 16:26:14.066777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5763): Terminated: ok {rc=0} 16:26:14.110590 --- ParallelTerminationStrategy: PID 5766 died... 16:26:14.129246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5766): Terminated: ok {rc=0} 16:26:14.172783 --- ParallelTerminationStrategy: PID 5769 died... 16:26:14.191362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5769): Terminated: ok {rc=0} 16:26:14.276590 bus /sierra_3: Setting Powered False 16:26:15.377533 bus /sierra_3: Setting Powered False 16:26:16.502041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:26:17.752197 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:26:17.757914 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:26:17.791216 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:26:17.817943 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:26:17.870100 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:26:17.904727 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:26:17.933051 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:26:18.478815 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:26:18.529405 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:18.540289 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:26:18.611069 tst mo_mt_call.py: using LAC 34828 16:26:18.734455 tst mo_mt_call.py: using RAC 148 16:26:18.865652 tst mo_mt_call.py: using CellId 34828 16:26:18.997076 tst mo_mt_call.py: using BVCI 34829 16:26:19.118288 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:19.129743 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:19.141323 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:19.152768 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:19.164504 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:19.176252 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:26:19.295520 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:26:19.418355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:19.933781 run create_hlr_db(pid=5775): Launched 16:26:20.062419 bus /sierra_2: Setting Powered False 16:26:21.129031 run create_hlr_db(pid=5775): Terminated: ok {rc=0} 16:26:21.594145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5777): Launched 16:26:21.929273 run osmo-hlr_10.42.42.2(pid=5778): Launched 16:26:22.057492 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:22.635309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5780): Launched 16:26:22.972258 run osmo-stp_10.42.42.5(pid=5781): Launched 16:26:23.102445 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:23.706932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5783): Launched 16:26:24.041343 run osmo-msc_10.42.42.6(pid=5784): Launched 16:26:24.228913 run osmo-stp_10.42.42.5(pid=5781): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5781)] 16:26:24.369206 run osmo-stp_10.42.42.5(pid=5781): stdout: | (launched: 2022-12-13_16:26:22.911294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:24.510526 run osmo-stp_10.42.42.5(pid=5781): stderr: | [0;m[38;5;43m20221213162623103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162623103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162623103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162623104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162623104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162623104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162623105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:24.649765 run osmo-stp_10.42.42.5(pid=5781): stdout: | (launched: 2022-12-13_16:26:22.911294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:24.782214 run osmo-stp_10.42.42.5(pid=5781): stderr: | [0;m[38;5;43m20221213162623103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162623103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162623103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162623104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162623104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162623104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162623105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:24.941037 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5781): Process ended prematurely: osmo-stp_10.42.42.5(pid=5781) [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5781)] [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:26:24.950771 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:26:24.978797 run osmo-hlr_10.42.42.2(pid=5778): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5778)] 16:26:25.030062 run osmo-hlr_10.42.42.2(pid=5778): stdout: | (launched: 2022-12-13_16:26:21.867995) 16:26:25.082738 run osmo-hlr_10.42.42.2(pid=5778): stderr: | [0;m[1;31m20221213162622066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162622066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162622066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162622066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162622066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162622066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162622082 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162622092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162622092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162622092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:25.157046 run osmo-msc_10.42.42.6(pid=5784): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5784)] 16:26:25.207655 run osmo-msc_10.42.42.6(pid=5784): stdout: | (launched: 2022-12-13_16:26:23.979725) 16:26:25.260459 run osmo-msc_10.42.42.6(pid=5784): stderr: | [0;m[38;5;43m20221213162624302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162624302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2492e86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162624303 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162624303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162624303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162624303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162624305 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162624305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162624305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162624305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:25.313393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5777): Terminating (SIGTERM) 16:26:25.355353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5780): Terminating (SIGTERM) 16:26:25.398516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5783): Terminating (SIGTERM) 16:26:25.440898 --- ParallelTerminationStrategy: PID 5777 died... 16:26:25.461411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5777): Terminated: ok {rc=0} 16:26:25.508216 --- ParallelTerminationStrategy: PID 5780 died... 16:26:25.528112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5780): Terminated: ok {rc=0} 16:26:25.574452 --- ParallelTerminationStrategy: PID 5783 died... 16:26:25.594357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5783): Terminated: ok {rc=0} 16:26:25.683654 bus /sierra_3: Setting Powered False 16:26:26.782013 bus /sierra_3: Setting Powered False 16:26:27.898046 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:26:29.046636 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:29.058642 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:26:29.130252 tst mo_mt_call_osmux.py: using LAC 34829 16:26:29.254788 tst mo_mt_call_osmux.py: using RAC 149 16:26:29.376488 tst mo_mt_call_osmux.py: using CellId 34829 16:26:29.497097 tst mo_mt_call_osmux.py: using BVCI 34830 16:26:29.609705 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:29.620643 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:29.631595 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:29.642533 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:29.653467 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:26:29.664875 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:26:29.783151 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:26:29.906466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:30.387642 run create_hlr_db(pid=5786): Launched 16:26:30.514796 bus /sierra_2: Setting Powered False 16:26:31.574903 run create_hlr_db(pid=5786): Terminated: ok {rc=0} 16:26:32.072928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5788): Launched 16:26:32.400208 run osmo-hlr_10.42.42.2(pid=5789): Launched 16:26:32.519493 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:33.066991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5791): Launched 16:26:33.380201 run osmo-stp_10.42.42.5(pid=5792): Launched 16:26:33.499627 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:34.063666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5794): Launched 16:26:34.376128 run osmo-msc_10.42.42.6(pid=5795): Launched 16:26:34.551288 run osmo-stp_10.42.42.5(pid=5792): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5792)] 16:26:34.683101 run osmo-stp_10.42.42.5(pid=5792): stdout: | (launched: 2022-12-13_16:26:33.323163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:34.813946 run osmo-stp_10.42.42.5(pid=5792): stderr: | [0;m[38;5;43m20221213162633495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162633495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162633495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162633495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162633496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162633496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162633496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:34.942777 run osmo-stp_10.42.42.5(pid=5792): stdout: | (launched: 2022-12-13_16:26:33.323163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:35.065854 run osmo-stp_10.42.42.5(pid=5792): stderr: | [0;m[38;5;43m20221213162633495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162633495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162633495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162633495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162633496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162633496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162633496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:35.213457 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5792): Process ended prematurely: osmo-stp_10.42.42.5(pid=5792) [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5792)] [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:26:35.222488 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:26:35.249261 run osmo-hlr_10.42.42.2(pid=5789): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5789)] 16:26:35.297350 run osmo-hlr_10.42.42.2(pid=5789): stdout: | (launched: 2022-12-13_16:26:32.343047) 16:26:35.346948 run osmo-hlr_10.42.42.2(pid=5789): stderr: | [0;m[1;31m20221213162632517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162632517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162632517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162632517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162632517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162632518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162632530 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162632538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162632538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162632538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:35.416091 run osmo-msc_10.42.42.6(pid=5795): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5795)] 16:26:35.464063 run osmo-msc_10.42.42.6(pid=5795): stdout: | (launched: 2022-12-13_16:26:34.318572) 16:26:35.513646 run osmo-msc_10.42.42.6(pid=5795): stderr: | [0;m[38;5;43m20221213162634590 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162634590 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fea7ededc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162634590 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162634590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162634590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162634591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162634592 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162634593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162634593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162634593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:35.563616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5788): Terminating (SIGTERM) 16:26:35.603480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5791): Terminating (SIGTERM) 16:26:35.643231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5794): Terminating (SIGTERM) 16:26:35.683213 --- ParallelTerminationStrategy: PID 5788 died... 16:26:35.702569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5788): Terminated: ok {rc=0} 16:26:35.747284 --- ParallelTerminationStrategy: PID 5791 died... 16:26:35.766192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5791): Terminated: ok {rc=0} 16:26:35.810465 --- ParallelTerminationStrategy: PID 5794 died... 16:26:35.829371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5794): Terminated: ok {rc=0} 16:26:35.917357 bus /sierra_3: Setting Powered False 16:26:37.018228 bus /sierra_3: Setting Powered False 16:26:38.136511 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 emergency:trx-lms --------------------------------------------------------------------- 16:26:39.389263 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:26:39.393624 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 16:26:39.426513 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:26:39.453803 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 16:26:39.543482 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 16:26:39.577986 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:26:39.606629 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 16:26:40.191808 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2391 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 16:26:40.197598 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:40.209111 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 16:26:40.262300 tst emergency_mo_mt_call.py: using LAC 34830 16:26:40.391259 tst emergency_mo_mt_call.py: using RAC 150 16:26:40.517825 tst emergency_mo_mt_call.py: using CellId 34830 16:26:40.646537 tst emergency_mo_mt_call.py: using BVCI 34831 16:26:40.765026 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:40.776314 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:40.787418 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:40.798496 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:40.809946 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:40.821446 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:26:40.940274 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:26:41.065168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:41.572393 run create_hlr_db(pid=5800): Launched 16:26:41.698517 bus /sierra_2: Setting Powered False 16:26:42.758918 run create_hlr_db(pid=5800): Terminated: ok {rc=0} 16:26:43.218265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5802): Launched 16:26:43.545579 run osmo-hlr_10.42.42.2(pid=5803): Launched 16:26:43.673975 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:44.238176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5805): Launched 16:26:44.566214 run osmo-stp_10.42.42.5(pid=5806): Launched 16:26:44.702600 tst emergency_mo_mt_call.py: using MSISDN 8220 16:26:44.873920 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:45.463170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5808): Launched 16:26:45.793502 run osmo-msc_10.42.42.6(pid=5809): Launched 16:26:46.123649 run osmo-stp_10.42.42.5(pid=5806): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5806)] 16:26:46.431272 run osmo-stp_10.42.42.5(pid=5806): stdout: | (launched: 2022-12-13_16:26:44.505867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:46.571328 run osmo-stp_10.42.42.5(pid=5806): stderr: | [0;m[38;5;43m20221213162644698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162644699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162644699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162644699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162644700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162644700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162644700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:46.710934 run osmo-stp_10.42.42.5(pid=5806): stdout: | (launched: 2022-12-13_16:26:44.505867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:46.844704 run osmo-stp_10.42.42.5(pid=5806): stderr: | [0;m[38;5;43m20221213162644698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162644699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162644699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162644699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162644700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162644700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162644700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:47.005091 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5806): Process ended prematurely: osmo-stp_10.42.42.5(pid=5806) [trial-2391↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5806)] [trial-2391↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 16:26:47.015344 tst emergency_mo_mt_call.py:19: Test FAILED (6.8 sec) 16:26:47.044322 run osmo-hlr_10.42.42.2(pid=5803): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5803)] 16:26:47.099992 run osmo-hlr_10.42.42.2(pid=5803): stdout: | (launched: 2022-12-13_16:26:43.485551) 16:26:47.155487 run osmo-hlr_10.42.42.2(pid=5803): stderr: | [0;m[1;31m20221213162643683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162643683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162643683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162643683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162643683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162643683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162643696 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162643704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162643705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162643705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:47.231401 run osmo-msc_10.42.42.6(pid=5809): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5809)] 16:26:47.284457 run osmo-msc_10.42.42.6(pid=5809): stdout: | (launched: 2022-12-13_16:26:45.732674) 16:26:47.337300 run osmo-msc_10.42.42.6(pid=5809): stderr: | [0;m[38;5;43m20221213162646266 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162646266 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdcd8192c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162646266 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162646266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162646267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162646267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162646269 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162646269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162646269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162646269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:47.390483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5802): Terminating (SIGTERM) 16:26:47.433763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5805): Terminating (SIGTERM) 16:26:47.477415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5808): Terminating (SIGTERM) 16:26:47.521582 --- ParallelTerminationStrategy: PID 5802 died... 16:26:47.542990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5802): Terminated: ok {rc=0} 16:26:47.591556 --- ParallelTerminationStrategy: PID 5805 died... 16:26:47.612479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5805): Terminated: ok {rc=0} 16:26:47.660457 --- ParallelTerminationStrategy: PID 5808 died... 16:26:47.680699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5808): Terminated: ok {rc=0} 16:26:47.770160 bus /sierra_3: Setting Powered False 16:26:48.870503 bus /sierra_3: Setting Powered False 16:26:49.989986 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 16:26:51.078684 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:51.090213 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 16:26:51.141322 tst emergency_preemptive_call.py: using LAC 34831 16:26:51.273280 tst emergency_preemptive_call.py: using RAC 151 16:26:51.400077 tst emergency_preemptive_call.py: using CellId 34831 16:26:51.526201 tst emergency_preemptive_call.py: using BVCI 34832 16:26:51.644399 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:51.655866 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:51.666986 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:51.678063 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:51.689519 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:26:51.700811 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:26:51.821569 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:26:51.943001 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:26:52.060924 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:26:52.179586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:52.652706 run create_hlr_db(pid=5811): Launched 16:26:52.778690 bus /sierra_2: Setting Powered False 16:26:53.839377 run create_hlr_db(pid=5811): Terminated: ok {rc=0} 16:26:54.287995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5813): Launched 16:26:54.619048 run osmo-hlr_10.42.42.2(pid=5814): Launched 16:26:54.745680 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:55.314219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5816): Launched 16:26:55.642548 run osmo-stp_10.42.42.5(pid=5817): Launched 16:26:55.778101 tst emergency_preemptive_call.py: using MSISDN 8221 16:26:55.950618 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:56.538648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5819): Launched 16:26:56.867062 run osmo-msc_10.42.42.6(pid=5820): Launched 16:26:57.051085 run osmo-stp_10.42.42.5(pid=5817): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5817)] 16:26:57.189612 run osmo-stp_10.42.42.5(pid=5817): stdout: | (launched: 2022-12-13_16:26:55.581885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:57.328038 run osmo-stp_10.42.42.5(pid=5817): stderr: | [0;m[38;5;43m20221213162655775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162655775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162655776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162655776 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162655777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162655777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162655777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:57.464390 run osmo-stp_10.42.42.5(pid=5817): stdout: | (launched: 2022-12-13_16:26:55.581885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:57.594806 run osmo-stp_10.42.42.5(pid=5817): stderr: | [0;m[38;5;43m20221213162655775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162655775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162655776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162655776 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162655777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162655777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162655777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:57.750453 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5817): Process ended prematurely: osmo-stp_10.42.42.5(pid=5817) [trial-2391↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5817)] [trial-2391↪emergency:trx-lms↪emergency_preemptive_call.py:32] 16:26:57.759616 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 16:26:57.787549 run osmo-hlr_10.42.42.2(pid=5814): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5814)] 16:26:57.839050 run osmo-hlr_10.42.42.2(pid=5814): stdout: | (launched: 2022-12-13_16:26:54.557773) 16:26:57.891522 run osmo-hlr_10.42.42.2(pid=5814): stderr: | [0;m[1;31m20221213162654756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162654756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162654756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162654756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162654756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162654756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162654768 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162654778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162654778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162654778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:57.964482 run osmo-msc_10.42.42.6(pid=5820): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5820)] 16:26:58.014798 run osmo-msc_10.42.42.6(pid=5820): stdout: | (launched: 2022-12-13_16:26:56.806878) 16:26:58.066941 run osmo-msc_10.42.42.6(pid=5820): stderr: | [0;m[38;5;43m20221213162657129 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213162657129 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feaae233c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213162657130 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213162657130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213162657130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213162657130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213162657132 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213162657132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213162657132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213162657132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:58.119761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5813): Terminating (SIGTERM) 16:26:58.162729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5816): Terminating (SIGTERM) 16:26:58.205276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5819): Terminating (SIGTERM) 16:26:58.248328 --- ParallelTerminationStrategy: PID 5813 died... 16:26:58.269249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5813): Terminated: ok {rc=0} 16:26:58.316190 --- ParallelTerminationStrategy: PID 5816 died... 16:26:58.336604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5816): Terminated: ok {rc=0} 16:26:58.383903 --- ParallelTerminationStrategy: PID 5819 died... 16:26:58.404001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5819): Terminated: ok {rc=0} 16:26:58.493289 bus /sierra_9: Setting Powered False 16:26:59.593410 bus /sierra_9: Setting Powered False 16:27:00.712053 bus /sierra_8: Setting Powered False 16:27:01.828184 bus /sierra_8: Setting Powered False 16:27:02.956239 bus /sierra_3: Setting Powered False 16:27:04.054288 bus /sierra_3: Setting Powered False 16:27:05.171025 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-lms --------------------------------------------------------------------- 16:27:06.455984 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:27:06.460636 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 16:27:06.494162 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 16:27:06.532819 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 16:27:06.618793 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 16:27:06.651964 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 16:27:06.690818 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 16:27:07.282736 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 16:27:07.333192 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:07.343785 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:27:07.391781 tst cs_paging_gprs_active.py: using LAC 34832 16:27:07.521822 tst cs_paging_gprs_active.py: using RAC 152 16:27:07.651665 tst cs_paging_gprs_active.py: using CellId 34832 16:27:07.780073 tst cs_paging_gprs_active.py: using BVCI 34833 16:27:07.900558 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:07.911771 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:07.922733 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:07.933836 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:07.945152 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:07.956302 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:07.967765 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:07.978921 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:07.990456 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:27:08.113220 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:27:08.236717 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:27:08.462491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:08.798301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5825): Launched 16:27:09.092793 run iperf3-srv_10.42.42.10(pid=5826): Launched 16:27:09.219184 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:27:09.444399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:09.780881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5827): Launched 16:27:10.074405 run iperf3-srv_10.42.42.10(pid=5828): Launched 16:27:10.202116 tst cs_paging_gprs_active.py:38: start network... 16:27:10.427763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:10.945329 run create_hlr_db(pid=5829): Launched 16:27:11.073761 bus /sierra_2: Setting Powered False 16:27:12.139644 run create_hlr_db(pid=5829): Terminated: ok {rc=0} 16:27:12.586336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5831): Launched 16:27:12.899335 run osmo-hlr_10.42.42.2(pid=5832): Launched 16:27:13.018578 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:13.570276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5834): Launched 16:27:13.884940 run osmo-stp_10.42.42.5(pid=5835): Launched 16:27:14.004918 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:14.545626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5837): Launched 16:27:14.665283 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:14.929388 run patchelf(pid=5838): Launched 16:27:15.103712 run osmo-stp_10.42.42.5(pid=5835): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5835)] 16:27:15.236267 run osmo-stp_10.42.42.5(pid=5835): stdout: | (launched: 2022-12-13_16:27:13.826618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:15.370007 run osmo-stp_10.42.42.5(pid=5835): stderr: | [0;m[38;5;43m20221213162714001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162714002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162714002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162714002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162714003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162714003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162714003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:15.503369 run osmo-stp_10.42.42.5(pid=5835): stdout: | (launched: 2022-12-13_16:27:13.826618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:15.631019 run osmo-stp_10.42.42.5(pid=5835): stderr: | [0;m[38;5;43m20221213162714001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162714002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162714002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162714002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162714003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162714003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162714003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:15.781821 run patchelf(pid=5838): Terminating (SIGINT) 16:27:15.993240 run patchelf(pid=5838): Terminated: ok {rc=0} 16:27:16.128911 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5835): Process ended prematurely: osmo-stp_10.42.42.5(pid=5835) [trial-2391↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5835)] [trial-2391↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 16:27:16.139275 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:27:16.168360 run osmo-hlr_10.42.42.2(pid=5832): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5832)] 16:27:16.219027 run osmo-hlr_10.42.42.2(pid=5832): stdout: | (launched: 2022-12-13_16:27:12.841668) 16:27:16.270623 run osmo-hlr_10.42.42.2(pid=5832): stderr: | [0;m[1;31m20221213162713017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162713017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162713017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162713017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162713017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162713017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162713029 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162713038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162713038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162713038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:16.322673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5825): Terminating (SIGTERM) 16:27:16.375055 run iperf3-srv_10.42.42.10(pid=5826): Terminating (SIGTERM) 16:27:16.432552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5827): Terminating (SIGTERM) 16:27:16.492848 run iperf3-srv_10.42.42.10(pid=5828): Terminating (SIGTERM) 16:27:16.555083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5831): Terminating (SIGTERM) 16:27:16.611035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5834): Terminating (SIGTERM) 16:27:16.663419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5837): Terminating (SIGTERM) 16:27:16.704722 --- ParallelTerminationStrategy: PID 5825 died... 16:27:16.724513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5825): Terminated: ok {rc=0} 16:27:16.770033 --- ParallelTerminationStrategy: PID 5826 died... 16:27:16.789485 run iperf3-srv_10.42.42.10(pid=5826): Terminated {rc=256} 16:27:16.834555 --- ParallelTerminationStrategy: PID 5827 died... 16:27:16.853958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5827): Terminated: ok {rc=0} 16:27:16.899282 --- ParallelTerminationStrategy: PID 5828 died... 16:27:16.918873 run iperf3-srv_10.42.42.10(pid=5828): Terminated {rc=256} 16:27:16.964271 --- ParallelTerminationStrategy: PID 5831 died... 16:27:16.983773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5831): Terminated: ok {rc=0} 16:27:17.028818 --- ParallelTerminationStrategy: PID 5834 died... 16:27:17.048578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5834): Terminated: ok {rc=0} 16:27:17.093856 --- ParallelTerminationStrategy: PID 5837 died... 16:27:17.113679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5837): Terminated: ok {rc=0} 16:27:17.200195 bus /gobi_0: Setting Powered False 16:27:18.304336 bus /gobi_0: Setting Powered False 16:27:19.426503 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms iperf3.py ---------------------------------------------- 16:27:20.575006 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:20.586701 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:27:20.638842 tst iperf3.py: using LAC 34833 16:27:20.762609 tst iperf3.py: using RAC 153 16:27:20.885619 tst iperf3.py: using CellId 34833 16:27:21.008419 tst iperf3.py: using BVCI 34834 16:27:21.120696 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:21.131523 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:21.142195 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:21.152761 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:21.163261 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:21.173759 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:21.184401 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:21.194885 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:21.205605 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:27:21.325999 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:27:21.535697 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:21.850651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5839): Launched 16:27:22.126951 run iperf3-srv_10.42.42.10(pid=5840): Launched 16:27:22.244940 tst iperf3.py:8: start network... 16:27:22.454584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:22.939508 run create_hlr_db(pid=5841): Launched 16:27:23.067220 bus /gobi_6: Setting Powered False 16:27:24.130180 run create_hlr_db(pid=5841): Terminated: ok {rc=0} 16:27:24.586216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5843): Launched 16:27:24.923446 run osmo-hlr_10.42.42.2(pid=5844): Launched 16:27:25.054116 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:25.636343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5846): Launched 16:27:25.973213 run osmo-stp_10.42.42.5(pid=5847): Launched 16:27:26.102689 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:26.679701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5849): Launched 16:27:26.808416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:27.091852 run patchelf(pid=5850): Launched 16:27:27.280370 run osmo-stp_10.42.42.5(pid=5847): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5847)] 16:27:27.422042 run osmo-stp_10.42.42.5(pid=5847): stdout: | (launched: 2022-12-13_16:27:25.911690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:27.565788 run osmo-stp_10.42.42.5(pid=5847): stderr: | [0;m[38;5;43m20221213162726105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162726106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162726106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162726106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162726107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162726107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162726107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:27.709411 run osmo-stp_10.42.42.5(pid=5847): stdout: | (launched: 2022-12-13_16:27:25.911690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:27.846286 run osmo-stp_10.42.42.5(pid=5847): stderr: | [0;m[38;5;43m20221213162726105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162726106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162726106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162726106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162726107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162726107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162726107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:28.008453 run patchelf(pid=5850): Terminating (SIGINT) 16:27:28.197228 run patchelf(pid=5850): Terminated: ok {rc=0} 16:27:28.333227 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5847): Process ended prematurely: osmo-stp_10.42.42.5(pid=5847) [trial-2391↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5847)] [trial-2391↪gprs:trx-lms↪iperf3.py:8] 16:27:28.343595 tst iperf3.py:8: Test FAILED (7.8 sec) 16:27:28.372830 run osmo-hlr_10.42.42.2(pid=5844): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5844)] 16:27:28.424574 run osmo-hlr_10.42.42.2(pid=5844): stdout: | (launched: 2022-12-13_16:27:24.862233) 16:27:28.478213 run osmo-hlr_10.42.42.2(pid=5844): stderr: | [0;m[1;31m20221213162725060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162725060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162725060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162725060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162725060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162725060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162725075 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162725085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162725087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162725087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:28.531809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5839): Terminating (SIGTERM) 16:27:28.575033 run iperf3-srv_10.42.42.10(pid=5840): Terminating (SIGTERM) 16:27:28.618627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5843): Terminating (SIGTERM) 16:27:28.662315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5846): Terminating (SIGTERM) 16:27:28.705797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5849): Terminating (SIGTERM) 16:27:28.749629 --- ParallelTerminationStrategy: PID 5839 died... 16:27:28.770813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5839): Terminated: ok {rc=0} 16:27:28.818818 --- ParallelTerminationStrategy: PID 5840 died... 16:27:28.839327 run iperf3-srv_10.42.42.10(pid=5840): Terminated {rc=256} 16:27:28.886627 --- ParallelTerminationStrategy: PID 5843 died... 16:27:28.907425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5843): Terminated: ok {rc=0} 16:27:28.954929 --- ParallelTerminationStrategy: PID 5846 died... 16:27:28.975453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5846): Terminated: ok {rc=0} 16:27:29.023030 --- ParallelTerminationStrategy: PID 5849 died... 16:27:29.043626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5849): Terminated: ok {rc=0} 16:27:29.134593 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms iperf3m4.py ---------------------------------------------- 16:27:30.288336 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:30.300582 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:27:30.350728 tst iperf3m4.py: using LAC 34834 16:27:30.480248 tst iperf3m4.py: using RAC 154 16:27:30.609347 tst iperf3m4.py: using CellId 34834 16:27:30.738247 tst iperf3m4.py: using BVCI 34835 16:27:30.866531 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:30.878666 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:30.890681 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:30.910639 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:30.926811 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:30.940689 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:30.967367 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:30.980597 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:30.993981 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:27:31.121970 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:27:31.255049 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:27:31.408823 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:27:31.558597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:27:31.846292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:32.274307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5851): Launched 16:27:32.569360 run iperf3-srv_10.42.42.10(pid=5852): Launched 16:27:32.687545 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:27:32.896608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:33.210881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5853): Launched 16:27:33.484283 run iperf3-srv_10.42.42.10(pid=5854): Launched 16:27:33.602588 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:27:33.812205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:34.127469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5855): Launched 16:27:34.401827 run iperf3-srv_10.42.42.10(pid=5856): Launched 16:27:34.518931 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:27:34.728108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:35.041725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5857): Launched 16:27:35.314363 run iperf3-srv_10.42.42.10(pid=5858): Launched 16:27:35.432051 tst iperf3m4.py:8: start network... 16:27:35.641557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:36.127137 run create_hlr_db(pid=5859): Launched 16:27:36.256369 bus /gobi_6: Setting Powered False 16:27:37.318490 run create_hlr_db(pid=5859): Terminated: ok {rc=0} 16:27:37.775922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5861): Launched 16:27:38.114764 run osmo-hlr_10.42.42.2(pid=5862): Launched 16:27:38.245832 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:38.825436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5864): Launched 16:27:39.160662 run osmo-stp_10.42.42.5(pid=5865): Launched 16:27:39.289637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:39.866367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5867): Launched 16:27:39.996754 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:40.280290 run patchelf(pid=5868): Launched 16:27:40.468530 run osmo-stp_10.42.42.5(pid=5865): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5865)] 16:27:40.610288 run osmo-stp_10.42.42.5(pid=5865): stdout: | (launched: 2022-12-13_16:27:39.098803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:40.753758 run osmo-stp_10.42.42.5(pid=5865): stderr: | [0;m[38;5;43m20221213162739290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162739290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162739290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162739291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162739291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162739291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162739291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:40.897189 run osmo-stp_10.42.42.5(pid=5865): stdout: | (launched: 2022-12-13_16:27:39.098803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:41.034281 run osmo-stp_10.42.42.5(pid=5865): stderr: | [0;m[38;5;43m20221213162739290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162739290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162739290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162739291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162739291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162739291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162739291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:41.196903 run patchelf(pid=5868): Terminating (SIGINT) 16:27:41.384765 run patchelf(pid=5868): Terminated: ok {rc=0} 16:27:41.520459 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5865): Process ended prematurely: osmo-stp_10.42.42.5(pid=5865) [trial-2391↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5865)] [trial-2391↪gprs:trx-lms↪iperf3m4.py:8] 16:27:41.531559 tst iperf3m4.py:8: Test FAILED (11.3 sec) 16:27:41.561198 run osmo-hlr_10.42.42.2(pid=5862): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5862)] 16:27:41.613141 run osmo-hlr_10.42.42.2(pid=5862): stdout: | (launched: 2022-12-13_16:27:38.053055) 16:27:41.666386 run osmo-hlr_10.42.42.2(pid=5862): stderr: | [0;m[1;31m20221213162738249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162738249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162738249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162738249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162738249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162738249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162738261 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162738269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162738270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162738270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:41.719444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5851): Terminating (SIGTERM) 16:27:41.762328 run iperf3-srv_10.42.42.10(pid=5852): Terminating (SIGTERM) 16:27:41.805509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5853): Terminating (SIGTERM) 16:27:41.848493 run iperf3-srv_10.42.42.10(pid=5854): Terminating (SIGTERM) 16:27:41.891358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5855): Terminating (SIGTERM) 16:27:41.934258 run iperf3-srv_10.42.42.10(pid=5856): Terminating (SIGTERM) 16:27:41.977354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5857): Terminating (SIGTERM) 16:27:42.020296 run iperf3-srv_10.42.42.10(pid=5858): Terminating (SIGTERM) 16:27:42.063057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5861): Terminating (SIGTERM) 16:27:42.106232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5864): Terminating (SIGTERM) 16:27:42.149256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5867): Terminating (SIGTERM) 16:27:42.192697 --- ParallelTerminationStrategy: PID 5851 died... 16:27:42.213303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5851): Terminated: ok {rc=0} 16:27:42.260315 --- ParallelTerminationStrategy: PID 5852 died... 16:27:42.280659 run iperf3-srv_10.42.42.10(pid=5852): Terminated {rc=256} 16:27:42.327468 --- ParallelTerminationStrategy: PID 5853 died... 16:27:42.347521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5853): Terminated: ok {rc=0} 16:27:42.394353 --- ParallelTerminationStrategy: PID 5854 died... 16:27:42.414373 run iperf3-srv_10.42.42.10(pid=5854): Terminated {rc=256} 16:27:42.460629 --- ParallelTerminationStrategy: PID 5855 died... 16:27:42.480790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5855): Terminated: ok {rc=0} 16:27:42.527367 --- ParallelTerminationStrategy: PID 5856 died... 16:27:42.547336 run iperf3-srv_10.42.42.10(pid=5856): Terminated {rc=256} 16:27:42.593818 --- ParallelTerminationStrategy: PID 5857 died... 16:27:42.613930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5857): Terminated: ok {rc=0} 16:27:42.660466 --- ParallelTerminationStrategy: PID 5858 died... 16:27:42.680550 run iperf3-srv_10.42.42.10(pid=5858): Terminated {rc=256} 16:27:42.727104 --- ParallelTerminationStrategy: PID 5861 died... 16:27:42.747254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5861): Terminated: ok {rc=0} 16:27:42.794057 --- ParallelTerminationStrategy: PID 5864 died... 16:27:42.814173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5864): Terminated: ok {rc=0} 16:27:42.860867 --- ParallelTerminationStrategy: PID 5867 died... 16:27:42.881731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5867): Terminated: ok {rc=0} 16:27:42.971152 bus /gobi_4: Setting Powered False 16:27:44.070044 bus /gobi_4: Setting Powered False 16:27:45.187177 bus /gobi_1: Setting Powered False 16:27:46.283740 bus /gobi_1: Setting Powered False 16:27:47.403287 bus /gobi_0: Setting Powered False 16:27:48.502544 bus /gobi_0: Setting Powered False 16:27:49.621433 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms ping.py ---------------------------------------------- 16:27:50.724482 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:50.736110 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:27:50.785842 tst ping.py: using LAC 34835 16:27:50.905932 tst ping.py: using RAC 155 16:27:51.025210 tst ping.py: using CellId 34835 16:27:51.144569 tst ping.py: using BVCI 34836 16:27:51.256450 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:51.267169 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:51.277762 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:51.288309 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:51.298714 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:51.309097 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:51.319642 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:51.330209 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:27:51.447072 tst ping.py:19: start network... 16:27:51.652194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:52.126818 run create_hlr_db(pid=5869): Launched 16:27:52.254895 bus /gobi_6: Setting Powered False 16:27:53.316160 run create_hlr_db(pid=5869): Terminated: ok {rc=0} 16:27:53.765605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5871): Launched 16:27:54.096633 run osmo-hlr_10.42.42.2(pid=5872): Launched 16:27:54.224137 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:54.795967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5874): Launched 16:27:55.126924 run osmo-stp_10.42.42.5(pid=5875): Launched 16:27:55.255108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:55.822255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5877): Launched 16:27:55.949998 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:56.228393 run patchelf(pid=5878): Launched 16:27:56.413540 run osmo-stp_10.42.42.5(pid=5875): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5875)] 16:27:56.552830 run osmo-stp_10.42.42.5(pid=5875): stdout: | (launched: 2022-12-13_16:27:55.066302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:56.694426 run osmo-stp_10.42.42.5(pid=5875): stderr: | [0;m[38;5;43m20221213162755257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162755258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162755258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162755258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162755259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162755259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162755259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:56.836039 run osmo-stp_10.42.42.5(pid=5875): stdout: | (launched: 2022-12-13_16:27:55.066302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:56.970750 run osmo-stp_10.42.42.5(pid=5875): stderr: | [0;m[38;5;43m20221213162755257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162755258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162755258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162755258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162755259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162755259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162755259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:57.130198 run patchelf(pid=5878): Terminating (SIGINT) 16:27:57.314957 run patchelf(pid=5878): Terminated: ok {rc=0} 16:27:57.447834 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5875): Process ended prematurely: osmo-stp_10.42.42.5(pid=5875) [trial-2391↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5875)] [trial-2391↪gprs:trx-lms↪ping.py:22] 16:27:57.457726 tst ping.py:22: Test FAILED (6.7 sec) 16:27:57.486606 run osmo-hlr_10.42.42.2(pid=5872): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5872)] 16:27:57.538472 run osmo-hlr_10.42.42.2(pid=5872): stdout: | (launched: 2022-12-13_16:27:54.036144) 16:27:57.591959 run osmo-hlr_10.42.42.2(pid=5872): stderr: | [0;m[1;31m20221213162754231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162754231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162754231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162754231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162754231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162754232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162754243 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162754253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162754253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162754253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:57.645615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5871): Terminating (SIGTERM) 16:27:57.688667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5874): Terminating (SIGTERM) 16:27:57.731614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5877): Terminating (SIGTERM) 16:27:57.775155 --- ParallelTerminationStrategy: PID 5871 died... 16:27:57.796108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5871): Terminated: ok {rc=0} 16:27:57.843782 --- ParallelTerminationStrategy: PID 5874 died... 16:27:57.864195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5874): Terminated: ok {rc=0} 16:27:57.911524 --- ParallelTerminationStrategy: PID 5877 died... 16:27:57.931834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5877): Terminated: ok {rc=0} 16:27:58.022896 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 16:27:59.111950 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:59.124146 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:27:59.178973 tst ping_idle_ping.py: using LAC 34836 16:27:59.308859 tst ping_idle_ping.py: using RAC 156 16:27:59.439218 tst ping_idle_ping.py: using CellId 34836 16:27:59.569440 tst ping_idle_ping.py: using BVCI 34837 16:27:59.683348 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:59.694413 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:59.704936 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:59.715536 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:59.726004 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:59.736812 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:59.747872 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:27:59.758957 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:27:59.880212 tst ping_idle_ping.py:24: start network... 16:28:00.102540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:00.614708 run create_hlr_db(pid=5879): Launched 16:28:00.743313 bus /gobi_6: Setting Powered False 16:28:01.806411 run create_hlr_db(pid=5879): Terminated: ok {rc=0} 16:28:02.307765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5881): Launched 16:28:02.641370 run osmo-hlr_10.42.42.2(pid=5882): Launched 16:28:02.770595 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:03.341671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5884): Launched 16:28:03.671880 run osmo-stp_10.42.42.5(pid=5885): Launched 16:28:03.799546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:04.368357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5887): Launched 16:28:04.495810 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:04.774175 run patchelf(pid=5888): Launched 16:28:04.957937 run osmo-stp_10.42.42.5(pid=5885): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5885)] 16:28:05.097337 run osmo-stp_10.42.42.5(pid=5885): stdout: | (launched: 2022-12-13_16:28:03.611381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:05.239336 run osmo-stp_10.42.42.5(pid=5885): stderr: | [0;m[38;5;43m20221213162803806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162803806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162803806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162803807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162803807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162803807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162803807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:05.380747 run osmo-stp_10.42.42.5(pid=5885): stdout: | (launched: 2022-12-13_16:28:03.611381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:05.515719 run osmo-stp_10.42.42.5(pid=5885): stderr: | [0;m[38;5;43m20221213162803806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162803806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162803806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162803807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162803807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162803807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162803807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:05.675941 run patchelf(pid=5888): Terminating (SIGINT) 16:28:05.860399 run patchelf(pid=5888): Terminated: ok {rc=0} 16:28:05.993433 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5885): Process ended prematurely: osmo-stp_10.42.42.5(pid=5885) [trial-2391↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5885)] [trial-2391↪gprs:trx-lms↪ping_idle_ping.py:27] 16:28:06.003255 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 16:28:06.031855 run osmo-hlr_10.42.42.2(pid=5882): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5882)] 16:28:06.083388 run osmo-hlr_10.42.42.2(pid=5882): stdout: | (launched: 2022-12-13_16:28:02.580279) 16:28:06.136683 run osmo-hlr_10.42.42.2(pid=5882): stderr: | [0;m[1;31m20221213162802778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162802778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162802778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162802778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162802778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162802778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162802791 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162802799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162802799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162802799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:06.190225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5881): Terminating (SIGTERM) 16:28:06.233509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5884): Terminating (SIGTERM) 16:28:06.276862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5887): Terminating (SIGTERM) 16:28:06.320412 --- ParallelTerminationStrategy: PID 5881 died... 16:28:06.341305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5881): Terminated: ok {rc=0} 16:28:06.388872 --- ParallelTerminationStrategy: PID 5884 died... 16:28:06.409598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5884): Terminated: ok {rc=0} 16:28:06.456937 --- ParallelTerminationStrategy: PID 5887 died... 16:28:06.477511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5887): Terminated: ok {rc=0} 16:28:06.568153 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 16:28:07.877015 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:28:07.882839 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:28:07.917205 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:28:07.957512 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:28:08.050335 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:28:08.085333 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:28:08.126008 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:28:08.719416 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:28:08.774127 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:08.785637 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:28:08.838032 tst cs_paging_gprs_active.py: using LAC 34837 16:28:08.971221 tst cs_paging_gprs_active.py: using RAC 157 16:28:09.103815 tst cs_paging_gprs_active.py: using CellId 34837 16:28:09.235213 tst cs_paging_gprs_active.py: using BVCI 34838 16:28:09.358686 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:09.370368 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:09.381838 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:09.393418 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:09.405173 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:09.416860 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:09.429046 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:09.440897 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:09.453092 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:28:09.575422 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:28:09.697752 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:28:09.924726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:10.262425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5893): Launched 16:28:10.555956 run iperf3-srv_10.42.42.10(pid=5894): Launched 16:28:10.685108 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:28:10.911436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:11.250232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5895): Launched 16:28:11.544715 run iperf3-srv_10.42.42.10(pid=5896): Launched 16:28:11.672681 tst cs_paging_gprs_active.py:38: start network... 16:28:11.899814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:12.420122 run create_hlr_db(pid=5897): Launched 16:28:12.550014 bus /gobi_6: Setting Powered False 16:28:13.615856 run create_hlr_db(pid=5897): Terminated: ok {rc=0} 16:28:14.062620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5899): Launched 16:28:14.377508 run osmo-hlr_10.42.42.2(pid=5900): Launched 16:28:14.496442 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:15.034985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5902): Launched 16:28:15.349352 run osmo-stp_10.42.42.5(pid=5903): Launched 16:28:15.468466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:16.032082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5905): Launched 16:28:16.166067 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:16.436690 run patchelf(pid=5906): Launched 16:28:16.639348 run osmo-stp_10.42.42.5(pid=5903): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5903)] 16:28:16.788607 run osmo-stp_10.42.42.5(pid=5903): stdout: | (launched: 2022-12-13_16:28:15.291218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:16.937867 run osmo-stp_10.42.42.5(pid=5903): stderr: | [0;m[38;5;43m20221213162815462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162815463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162815463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162815463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162815464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162815464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162815464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:17.087993 run osmo-stp_10.42.42.5(pid=5903): stdout: | (launched: 2022-12-13_16:28:15.291218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:17.229453 run osmo-stp_10.42.42.5(pid=5903): stderr: | [0;m[38;5;43m20221213162815462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162815463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162815463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162815463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162815464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162815464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162815464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:17.393187 run patchelf(pid=5906): Terminating (SIGINT) 16:28:17.583423 run patchelf(pid=5906): Terminated: ok {rc=0} 16:28:17.720786 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5903): Process ended prematurely: osmo-stp_10.42.42.5(pid=5903) [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5903)] [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:28:17.731632 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:28:17.761185 run osmo-hlr_10.42.42.2(pid=5900): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5900)] 16:28:17.814123 run osmo-hlr_10.42.42.2(pid=5900): stdout: | (launched: 2022-12-13_16:28:14.319228) 16:28:17.867649 run osmo-hlr_10.42.42.2(pid=5900): stderr: | [0;m[1;31m20221213162814498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162814498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162814498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162814498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162814498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162814499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162814510 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162814518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162814518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162814518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:17.921396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5893): Terminating (SIGTERM) 16:28:17.964643 run iperf3-srv_10.42.42.10(pid=5894): Terminating (SIGTERM) 16:28:18.007600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5895): Terminating (SIGTERM) 16:28:18.051479 run iperf3-srv_10.42.42.10(pid=5896): Terminating (SIGTERM) 16:28:18.095000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5899): Terminating (SIGTERM) 16:28:18.138557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5902): Terminating (SIGTERM) 16:28:18.182256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5905): Terminating (SIGTERM) 16:28:18.226068 --- ParallelTerminationStrategy: PID 5893 died... 16:28:18.247009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5893): Terminated: ok {rc=0} 16:28:18.294369 --- ParallelTerminationStrategy: PID 5894 died... 16:28:18.314678 run iperf3-srv_10.42.42.10(pid=5894): Terminated {rc=256} 16:28:18.361739 --- ParallelTerminationStrategy: PID 5895 died... 16:28:18.382139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5895): Terminated: ok {rc=0} 16:28:18.429442 --- ParallelTerminationStrategy: PID 5896 died... 16:28:18.449849 run iperf3-srv_10.42.42.10(pid=5896): Terminated {rc=256} 16:28:18.497148 --- ParallelTerminationStrategy: PID 5899 died... 16:28:18.517682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5899): Terminated: ok {rc=0} 16:28:18.565328 --- ParallelTerminationStrategy: PID 5902 died... 16:28:18.585980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5902): Terminated: ok {rc=0} 16:28:18.633125 --- ParallelTerminationStrategy: PID 5905 died... 16:28:18.653387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5905): Terminated: ok {rc=0} 16:28:18.742910 bus /gobi_0: Setting Powered False 16:28:19.840324 bus /gobi_0: Setting Powered False 16:28:20.956880 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:28:22.106210 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:22.118122 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:28:22.177357 tst iperf3.py: using LAC 34838 16:28:22.308187 tst iperf3.py: using RAC 158 16:28:22.440109 tst iperf3.py: using CellId 34838 16:28:22.574461 tst iperf3.py: using BVCI 34839 16:28:22.696625 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:22.708333 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:22.719731 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:22.731091 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:22.742682 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:22.754311 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:22.766194 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:22.777768 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:22.789695 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:28:22.912405 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:28:23.138725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:23.476539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5907): Launched 16:28:23.770691 run iperf3-srv_10.42.42.10(pid=5908): Launched 16:28:23.896873 tst iperf3.py:8: start network... 16:28:24.122504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:24.641406 run create_hlr_db(pid=5909): Launched 16:28:24.769405 bus /gobi_6: Setting Powered False 16:28:25.834823 run create_hlr_db(pid=5909): Terminated: ok {rc=0} 16:28:26.285359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5911): Launched 16:28:26.599033 run osmo-hlr_10.42.42.2(pid=5912): Launched 16:28:26.720340 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:27.273746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5914): Launched 16:28:27.586320 run osmo-stp_10.42.42.5(pid=5915): Launched 16:28:27.706164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:28.244466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5917): Launched 16:28:28.365789 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:28.630198 run patchelf(pid=5918): Launched 16:28:28.804297 run osmo-stp_10.42.42.5(pid=5915): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5915)] 16:28:28.936196 run osmo-stp_10.42.42.5(pid=5915): stdout: | (launched: 2022-12-13_16:28:27.528149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:29.069924 run osmo-stp_10.42.42.5(pid=5915): stderr: | [0;m[38;5;43m20221213162827700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162827700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162827701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162827701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162827702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162827702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162827702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:29.204134 run osmo-stp_10.42.42.5(pid=5915): stdout: | (launched: 2022-12-13_16:28:27.528149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:29.331924 run osmo-stp_10.42.42.5(pid=5915): stderr: | [0;m[38;5;43m20221213162827700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162827700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162827701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162827701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162827702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162827702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162827702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:29.483721 run patchelf(pid=5918): Terminating (SIGINT) 16:28:29.659355 run patchelf(pid=5918): Terminated: ok {rc=0} 16:28:29.786170 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5915): Process ended prematurely: osmo-stp_10.42.42.5(pid=5915) [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5915)] [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 16:28:29.795696 tst iperf3.py:8: Test FAILED (7.7 sec) 16:28:29.823419 run osmo-hlr_10.42.42.2(pid=5912): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5912)] 16:28:29.872488 run osmo-hlr_10.42.42.2(pid=5912): stdout: | (launched: 2022-12-13_16:28:26.541241) 16:28:29.922919 run osmo-hlr_10.42.42.2(pid=5912): stderr: | [0;m[1;31m20221213162826718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162826718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162826718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162826718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162826718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162826718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162826730 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162826739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162826739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162826739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:29.973937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5907): Terminating (SIGTERM) 16:28:30.014506 run iperf3-srv_10.42.42.10(pid=5908): Terminating (SIGTERM) 16:28:30.054998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5911): Terminating (SIGTERM) 16:28:30.095550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5914): Terminating (SIGTERM) 16:28:30.136000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5917): Terminating (SIGTERM) 16:28:30.176649 --- ParallelTerminationStrategy: PID 5907 died... 16:28:30.196400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5907): Terminated: ok {rc=0} 16:28:30.240928 --- ParallelTerminationStrategy: PID 5908 died... 16:28:30.260003 run iperf3-srv_10.42.42.10(pid=5908): Terminated {rc=256} 16:28:30.304319 --- ParallelTerminationStrategy: PID 5911 died... 16:28:30.323361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5911): Terminated: ok {rc=0} 16:28:30.367743 --- ParallelTerminationStrategy: PID 5914 died... 16:28:30.386638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5914): Terminated: ok {rc=0} 16:28:30.430968 --- ParallelTerminationStrategy: PID 5917 died... 16:28:30.450089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5917): Terminated: ok {rc=0} 16:28:30.534750 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:28:31.691121 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:31.705075 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:28:31.762496 tst iperf3m4.py: using LAC 34839 16:28:31.895986 tst iperf3m4.py: using RAC 159 16:28:32.032903 tst iperf3m4.py: using CellId 34839 16:28:32.193065 tst iperf3m4.py: using BVCI 34840 16:28:32.308943 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:32.320169 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:32.331200 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:32.342153 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:32.353366 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:32.364272 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:32.375634 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:32.386796 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:32.397860 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:28:32.516421 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:28:32.640062 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:28:32.760447 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:28:32.880188 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:28:33.090441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:33.405066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5919): Launched 16:28:33.678994 run iperf3-srv_10.42.42.10(pid=5920): Launched 16:28:33.799387 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:28:34.009302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:34.323733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5921): Launched 16:28:34.597576 run iperf3-srv_10.42.42.10(pid=5922): Launched 16:28:34.715814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:28:34.924716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:35.239031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5923): Launched 16:28:35.521768 run iperf3-srv_10.42.42.10(pid=5924): Launched 16:28:35.647991 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:28:35.873940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:36.210651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5925): Launched 16:28:36.502298 run iperf3-srv_10.42.42.10(pid=5926): Launched 16:28:36.628005 tst iperf3m4.py:8: start network... 16:28:36.853683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:37.374354 run create_hlr_db(pid=5927): Launched 16:28:37.502778 bus /gobi_6: Setting Powered False 16:28:38.568408 run create_hlr_db(pid=5927): Terminated: ok {rc=0} 16:28:39.033222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5929): Launched 16:28:39.369128 run osmo-hlr_10.42.42.2(pid=5930): Launched 16:28:39.498410 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:40.076734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5932): Launched 16:28:40.413322 run osmo-stp_10.42.42.5(pid=5933): Launched 16:28:40.542124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:41.117192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5935): Launched 16:28:41.247641 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:41.530776 run patchelf(pid=5936): Launched 16:28:41.717693 run osmo-stp_10.42.42.5(pid=5933): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5933)] 16:28:41.859774 run osmo-stp_10.42.42.5(pid=5933): stdout: | (launched: 2022-12-13_16:28:40.351859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:42.004035 run osmo-stp_10.42.42.5(pid=5933): stderr: | [0;m[38;5;43m20221213162840543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162840543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162840543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162840544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162840544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162840544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162840545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:42.148127 run osmo-stp_10.42.42.5(pid=5933): stdout: | (launched: 2022-12-13_16:28:40.351859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:42.285954 run osmo-stp_10.42.42.5(pid=5933): stderr: | [0;m[38;5;43m20221213162840543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162840543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162840543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162840544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162840544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162840544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162840545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:42.448465 run patchelf(pid=5936): Terminating (SIGINT) 16:28:42.636338 run patchelf(pid=5936): Terminated: ok {rc=0} 16:28:42.772841 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5933): Process ended prematurely: osmo-stp_10.42.42.5(pid=5933) [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5933)] [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 16:28:42.783396 tst iperf3m4.py:8: Test FAILED (11.1 sec) 16:28:42.812497 run osmo-hlr_10.42.42.2(pid=5930): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5930)] 16:28:42.864537 run osmo-hlr_10.42.42.2(pid=5930): stdout: | (launched: 2022-12-13_16:28:39.307322) 16:28:42.917384 run osmo-hlr_10.42.42.2(pid=5930): stderr: | [0;m[1;31m20221213162839505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162839505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162839505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162839505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162839505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162839505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162839517 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162839526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162839526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162839526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:42.970474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5919): Terminating (SIGTERM) 16:28:43.013642 run iperf3-srv_10.42.42.10(pid=5920): Terminating (SIGTERM) 16:28:43.056837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5921): Terminating (SIGTERM) 16:28:43.099817 run iperf3-srv_10.42.42.10(pid=5922): Terminating (SIGTERM) 16:28:43.143079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5923): Terminating (SIGTERM) 16:28:43.186824 run iperf3-srv_10.42.42.10(pid=5924): Terminating (SIGTERM) 16:28:43.229792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5925): Terminating (SIGTERM) 16:28:43.272649 run iperf3-srv_10.42.42.10(pid=5926): Terminating (SIGTERM) 16:28:43.315572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5929): Terminating (SIGTERM) 16:28:43.358338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5932): Terminating (SIGTERM) 16:28:43.401437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5935): Terminating (SIGTERM) 16:28:43.444623 --- ParallelTerminationStrategy: PID 5919 died... 16:28:43.465460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5919): Terminated: ok {rc=0} 16:28:43.512793 --- ParallelTerminationStrategy: PID 5920 died... 16:28:43.533797 run iperf3-srv_10.42.42.10(pid=5920): Terminated {rc=256} 16:28:43.581320 --- ParallelTerminationStrategy: PID 5921 died... 16:28:43.601724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5921): Terminated: ok {rc=0} 16:28:43.649078 --- ParallelTerminationStrategy: PID 5922 died... 16:28:43.669494 run iperf3-srv_10.42.42.10(pid=5922): Terminated {rc=256} 16:28:43.716889 --- ParallelTerminationStrategy: PID 5923 died... 16:28:43.737300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5923): Terminated: ok {rc=0} 16:28:43.784750 --- ParallelTerminationStrategy: PID 5924 died... 16:28:43.805210 run iperf3-srv_10.42.42.10(pid=5924): Terminated {rc=256} 16:28:43.852429 --- ParallelTerminationStrategy: PID 5925 died... 16:28:43.872857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5925): Terminated: ok {rc=0} 16:28:43.920417 --- ParallelTerminationStrategy: PID 5926 died... 16:28:43.940851 run iperf3-srv_10.42.42.10(pid=5926): Terminated {rc=256} 16:28:43.988268 --- ParallelTerminationStrategy: PID 5929 died... 16:28:44.008668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5929): Terminated: ok {rc=0} 16:28:44.056192 --- ParallelTerminationStrategy: PID 5932 died... 16:28:44.076662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5932): Terminated: ok {rc=0} 16:28:44.124295 --- ParallelTerminationStrategy: PID 5935 died... 16:28:44.144889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5935): Terminated: ok {rc=0} 16:28:44.234854 bus /gobi_4: Setting Powered False 16:28:45.333123 bus /gobi_4: Setting Powered False 16:28:46.461222 bus /gobi_1: Setting Powered False 16:28:47.575716 bus /gobi_1: Setting Powered False 16:28:48.693818 bus /gobi_0: Setting Powered False 16:28:49.792863 bus /gobi_0: Setting Powered False 16:28:50.912652 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 16:28:52.018538 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:52.031063 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:28:52.085586 tst ping.py: using LAC 34840 16:28:52.208104 tst ping.py: using RAC 160 16:28:52.330812 tst ping.py: using CellId 34840 16:28:52.453486 tst ping.py: using BVCI 34841 16:28:52.565243 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:52.576334 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:52.587416 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:52.598297 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:52.608939 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:52.619619 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:52.631015 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:28:52.642051 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:28:52.758554 tst ping.py:19: start network... 16:28:52.964577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:53.438320 run create_hlr_db(pid=5937): Launched 16:28:53.567179 bus /gobi_6: Setting Powered False 16:28:54.631783 run create_hlr_db(pid=5937): Terminated: ok {rc=0} 16:28:55.089120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5939): Launched 16:28:55.418788 run osmo-hlr_10.42.42.2(pid=5940): Launched 16:28:55.546180 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:56.117751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5942): Launched 16:28:56.448568 run osmo-stp_10.42.42.5(pid=5943): Launched 16:28:56.576835 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:57.143645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5945): Launched 16:28:57.271187 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:57.548361 run patchelf(pid=5946): Launched 16:28:57.732245 run osmo-stp_10.42.42.5(pid=5943): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5943)] 16:28:57.871121 run osmo-stp_10.42.42.5(pid=5943): stdout: | (launched: 2022-12-13_16:28:56.387783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:58.012159 run osmo-stp_10.42.42.5(pid=5943): stderr: | [0;m[38;5;43m20221213162856583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162856583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162856583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162856583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162856584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162856584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162856584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:58.152771 run osmo-stp_10.42.42.5(pid=5943): stdout: | (launched: 2022-12-13_16:28:56.387783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:58.287416 run osmo-stp_10.42.42.5(pid=5943): stderr: | [0;m[38;5;43m20221213162856583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162856583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162856583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162856583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162856584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162856584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162856584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:58.446447 run patchelf(pid=5946): Terminating (SIGINT) 16:28:58.629674 run patchelf(pid=5946): Terminated: ok {rc=0} 16:28:58.761784 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5943): Process ended prematurely: osmo-stp_10.42.42.5(pid=5943) [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5943)] [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 16:28:58.771573 tst ping.py:22: Test FAILED (6.7 sec) 16:28:58.799961 run osmo-hlr_10.42.42.2(pid=5940): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5940)] 16:28:58.851003 run osmo-hlr_10.42.42.2(pid=5940): stdout: | (launched: 2022-12-13_16:28:55.358377) 16:28:58.903753 run osmo-hlr_10.42.42.2(pid=5940): stderr: | [0;m[1;31m20221213162855557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162855557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162855557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162855557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162855557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162855557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162855569 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162855579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162855579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162855579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:58.956823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5939): Terminating (SIGTERM) 16:28:58.999458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5942): Terminating (SIGTERM) 16:28:59.042312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5945): Terminating (SIGTERM) 16:28:59.085473 --- ParallelTerminationStrategy: PID 5939 died... 16:28:59.106287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5939): Terminated: ok {rc=0} 16:28:59.153205 --- ParallelTerminationStrategy: PID 5942 died... 16:28:59.173552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5942): Terminated: ok {rc=0} 16:28:59.220419 --- ParallelTerminationStrategy: PID 5945 died... 16:28:59.240592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5945): Terminated: ok {rc=0} 16:28:59.330032 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:29:00.416371 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:00.428830 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:29:00.483677 tst ping_idle_ping.py: using LAC 34841 16:29:00.612543 tst ping_idle_ping.py: using RAC 161 16:29:00.746563 tst ping_idle_ping.py: using CellId 34841 16:29:00.882310 tst ping_idle_ping.py: using BVCI 34842 16:29:01.010800 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:01.023317 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:01.035533 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:01.047938 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:01.061115 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:01.074367 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:01.088063 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:01.101616 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:29:01.250637 tst ping_idle_ping.py:24: start network... 16:29:01.498798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:02.034198 run create_hlr_db(pid=5947): Launched 16:29:02.205277 bus /gobi_6: Setting Powered False 16:29:03.265683 run create_hlr_db(pid=5947): Terminated: ok {rc=0} 16:29:03.734384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5949): Launched 16:29:04.064658 run osmo-hlr_10.42.42.2(pid=5950): Launched 16:29:04.191864 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:04.761994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5952): Launched 16:29:05.093473 run osmo-stp_10.42.42.5(pid=5953): Launched 16:29:05.220540 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:05.790743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5955): Launched 16:29:05.917601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:06.196937 run patchelf(pid=5956): Launched 16:29:06.382000 run osmo-stp_10.42.42.5(pid=5953): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5953)] 16:29:06.521421 run osmo-stp_10.42.42.5(pid=5953): stdout: | (launched: 2022-12-13_16:29:05.032555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:06.662738 run osmo-stp_10.42.42.5(pid=5953): stderr: | [0;m[38;5;43m20221213162905224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162905224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162905224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162905225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162905225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162905225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162905225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:06.804423 run osmo-stp_10.42.42.5(pid=5953): stdout: | (launched: 2022-12-13_16:29:05.032555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:06.939425 run osmo-stp_10.42.42.5(pid=5953): stderr: | [0;m[38;5;43m20221213162905224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162905224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162905224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162905225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162905225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162905225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162905225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:07.099597 run patchelf(pid=5956): Terminating (SIGINT) 16:29:07.284586 run patchelf(pid=5956): Terminated: ok {rc=0} 16:29:07.417428 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5953): Process ended prematurely: osmo-stp_10.42.42.5(pid=5953) [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5953)] [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 16:29:07.427074 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 16:29:07.455736 run osmo-hlr_10.42.42.2(pid=5950): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5950)] 16:29:07.507289 run osmo-hlr_10.42.42.2(pid=5950): stdout: | (launched: 2022-12-13_16:29:04.003672) 16:29:07.560282 run osmo-hlr_10.42.42.2(pid=5950): stderr: | [0;m[1;31m20221213162904202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162904202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162904202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162904202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162904202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162904202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162904214 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162904225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162904225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162904225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:07.613626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5949): Terminating (SIGTERM) 16:29:07.655865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5952): Terminating (SIGTERM) 16:29:07.698845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5955): Terminating (SIGTERM) 16:29:07.741775 --- ParallelTerminationStrategy: PID 5949 died... 16:29:07.762620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5949): Terminated: ok {rc=0} 16:29:07.809774 --- ParallelTerminationStrategy: PID 5952 died... 16:29:07.830206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5952): Terminated: ok {rc=0} 16:29:07.877264 --- ParallelTerminationStrategy: PID 5955 died... 16:29:07.897786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5955): Terminated: ok {rc=0} 16:29:07.988287 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:29:09.301146 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:09.307974 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:29:09.343605 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:29:09.384219 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:29:09.475034 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:29:09.509551 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:29:09.549965 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:29:10.145731 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:29:10.198662 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:10.210034 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:29:10.281836 tst cs_paging_gprs_active.py: using LAC 34842 16:29:10.406394 tst cs_paging_gprs_active.py: using RAC 162 16:29:10.531375 tst cs_paging_gprs_active.py: using CellId 34842 16:29:10.655737 tst cs_paging_gprs_active.py: using BVCI 34843 16:29:10.771103 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:10.782268 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:10.793196 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:10.804004 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:10.814754 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:10.825764 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:10.836553 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:10.847730 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:10.858831 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:29:10.981774 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:29:11.107555 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:29:11.335684 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:11.672679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5961): Launched 16:29:11.966370 run iperf3-srv_10.42.42.10(pid=5962): Launched 16:29:12.093815 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:29:12.320528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:12.657770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5963): Launched 16:29:12.949833 run iperf3-srv_10.42.42.10(pid=5964): Launched 16:29:13.075715 tst cs_paging_gprs_active.py:38: start network... 16:29:13.301767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:13.819557 run create_hlr_db(pid=5965): Launched 16:29:13.948224 bus /gobi_6: Setting Powered False 16:29:15.014485 run create_hlr_db(pid=5965): Terminated: ok {rc=0} 16:29:15.460686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5967): Launched 16:29:15.772299 run osmo-hlr_10.42.42.2(pid=5968): Launched 16:29:15.899305 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:16.565095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5970): Launched 16:29:16.923218 run osmo-stp_10.42.42.5(pid=5971): Launched 16:29:17.078921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:17.797740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5973): Launched 16:29:17.925888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:18.216123 run patchelf(pid=5974): Launched 16:29:18.404636 run osmo-stp_10.42.42.5(pid=5971): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5971)] 16:29:18.546523 run osmo-stp_10.42.42.5(pid=5971): stdout: | (launched: 2022-12-13_16:29:16.858641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:18.689910 run osmo-stp_10.42.42.5(pid=5971): stderr: | [0;m[38;5;43m20221213162917227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162917227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162917227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162917228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162917228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162917228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162917228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:18.833460 run osmo-stp_10.42.42.5(pid=5971): stdout: | (launched: 2022-12-13_16:29:16.858641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:18.970262 run osmo-stp_10.42.42.5(pid=5971): stderr: | [0;m[38;5;43m20221213162917227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162917227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162917227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162917228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162917228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162917228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162917228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:19.132707 run patchelf(pid=5974): Terminating (SIGINT) 16:29:19.320876 run patchelf(pid=5974): Terminated: ok {rc=0} 16:29:19.456009 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5971): Process ended prematurely: osmo-stp_10.42.42.5(pid=5971) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5971)] [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:29:19.466437 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 16:29:19.495417 run osmo-hlr_10.42.42.2(pid=5968): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5968)] 16:29:19.546365 run osmo-hlr_10.42.42.2(pid=5968): stdout: | (launched: 2022-12-13_16:29:15.714815) 16:29:19.598624 run osmo-hlr_10.42.42.2(pid=5968): stderr: | [0;m[1;31m20221213162915989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162915989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162915989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162915989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162915989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162915989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162916007 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162916031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162916032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162916032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:19.651317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5961): Terminating (SIGTERM) 16:29:19.694062 run iperf3-srv_10.42.42.10(pid=5962): Terminating (SIGTERM) 16:29:19.737073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5963): Terminating (SIGTERM) 16:29:19.780168 run iperf3-srv_10.42.42.10(pid=5964): Terminating (SIGTERM) 16:29:19.822713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5967): Terminating (SIGTERM) 16:29:19.865847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5970): Terminating (SIGTERM) 16:29:19.908303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5973): Terminating (SIGTERM) 16:29:19.951354 --- ParallelTerminationStrategy: PID 5961 died... 16:29:19.971626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5961): Terminated: ok {rc=0} 16:29:20.018603 --- ParallelTerminationStrategy: PID 5962 died... 16:29:20.038565 run iperf3-srv_10.42.42.10(pid=5962): Terminated {rc=256} 16:29:20.085257 --- ParallelTerminationStrategy: PID 5963 died... 16:29:20.105256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5963): Terminated: ok {rc=0} 16:29:20.152089 --- ParallelTerminationStrategy: PID 5964 died... 16:29:20.172179 run iperf3-srv_10.42.42.10(pid=5964): Terminated {rc=256} 16:29:20.219536 --- ParallelTerminationStrategy: PID 5967 died... 16:29:20.239764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5967): Terminated: ok {rc=0} 16:29:20.286399 --- ParallelTerminationStrategy: PID 5970 died... 16:29:20.306592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5970): Terminated: ok {rc=0} 16:29:20.353502 --- ParallelTerminationStrategy: PID 5973 died... 16:29:20.373691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5973): Terminated: ok {rc=0} 16:29:20.462901 bus /gobi_0: Setting Powered False 16:29:21.562658 bus /gobi_0: Setting Powered False 16:29:22.680443 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:29:23.831010 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:23.843223 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:29:23.916848 tst iperf3.py: using LAC 34843 16:29:24.049299 tst iperf3.py: using RAC 163 16:29:24.178713 tst iperf3.py: using CellId 34843 16:29:24.311034 tst iperf3.py: using BVCI 34844 16:29:24.434341 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:24.445854 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:24.457272 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:24.468496 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:24.480171 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:24.491791 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:24.503460 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:24.515039 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:24.526697 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:29:24.647368 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:29:24.858603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:25.174874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5977): Launched 16:29:25.451330 run iperf3-srv_10.42.42.10(pid=5978): Launched 16:29:25.570072 tst iperf3.py:8: start network... 16:29:25.780808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:26.267469 run create_hlr_db(pid=5979): Launched 16:29:26.395722 bus /gobi_6: Setting Powered False 16:29:27.457751 run create_hlr_db(pid=5979): Terminated: ok {rc=0} 16:29:27.912678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5981): Launched 16:29:28.247982 run osmo-hlr_10.42.42.2(pid=5982): Launched 16:29:28.378046 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:28.956291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5984): Launched 16:29:29.293292 run osmo-stp_10.42.42.5(pid=5985): Launched 16:29:29.422848 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:29.999828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5987): Launched 16:29:30.130884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:30.414540 run patchelf(pid=5988): Launched 16:29:30.601297 run osmo-stp_10.42.42.5(pid=5985): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5985)] 16:29:30.742542 run osmo-stp_10.42.42.5(pid=5985): stdout: | (launched: 2022-12-13_16:29:29.231677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:30.906402 run osmo-stp_10.42.42.5(pid=5985): stderr: | [0;m[38;5;43m20221213162929424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162929425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162929425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162929425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162929426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162929426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162929426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:31.046851 run osmo-stp_10.42.42.5(pid=5985): stdout: | (launched: 2022-12-13_16:29:29.231677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:31.182110 run osmo-stp_10.42.42.5(pid=5985): stderr: | [0;m[38;5;43m20221213162929424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162929425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162929425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162929425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162929426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162929426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162929426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:31.339067 run patchelf(pid=5988): Terminating (SIGINT) 16:29:31.519848 run patchelf(pid=5988): Terminated: ok {rc=0} 16:29:31.650510 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5985): Process ended prematurely: osmo-stp_10.42.42.5(pid=5985) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5985)] [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 16:29:31.660865 tst iperf3.py:8: Test FAILED (7.9 sec) 16:29:31.689896 run osmo-hlr_10.42.42.2(pid=5982): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5982)] 16:29:31.740238 run osmo-hlr_10.42.42.2(pid=5982): stdout: | (launched: 2022-12-13_16:29:28.186590) 16:29:31.793069 run osmo-hlr_10.42.42.2(pid=5982): stderr: | [0;m[1;31m20221213162928387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162928387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162928387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162928387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162928387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162928387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162928399 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162928408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162928408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162928408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:31.845133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5977): Terminating (SIGTERM) 16:29:31.886854 run iperf3-srv_10.42.42.10(pid=5978): Terminating (SIGTERM) 16:29:31.929224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5981): Terminating (SIGTERM) 16:29:31.971572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5984): Terminating (SIGTERM) 16:29:32.015239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5987): Terminating (SIGTERM) 16:29:32.060942 --- ParallelTerminationStrategy: PID 5977 died... 16:29:32.080934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5977): Terminated: ok {rc=0} 16:29:32.129125 --- ParallelTerminationStrategy: PID 5978 died... 16:29:32.148430 run iperf3-srv_10.42.42.10(pid=5978): Terminated {rc=256} 16:29:32.193538 --- ParallelTerminationStrategy: PID 5981 died... 16:29:32.213266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5981): Terminated: ok {rc=0} 16:29:32.258763 --- ParallelTerminationStrategy: PID 5984 died... 16:29:32.277705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5984): Terminated: ok {rc=0} 16:29:32.322276 --- ParallelTerminationStrategy: PID 5987 died... 16:29:32.342685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5987): Terminated: ok {rc=0} 16:29:32.427610 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:29:33.581063 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:33.593366 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:29:33.671081 tst iperf3m4.py: using LAC 34844 16:29:33.800857 tst iperf3m4.py: using RAC 164 16:29:33.929780 tst iperf3m4.py: using CellId 34844 16:29:34.053553 tst iperf3m4.py: using BVCI 34845 16:29:34.176801 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:34.188748 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:34.200153 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:34.211575 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:34.223131 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:34.234966 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:34.246779 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:34.258317 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:34.270190 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:29:34.391387 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:29:34.515740 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:29:34.636825 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:29:34.759979 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:29:34.986981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:35.324186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5989): Launched 16:29:35.619685 run iperf3-srv_10.42.42.10(pid=5990): Launched 16:29:35.747327 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:29:35.974625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:36.312661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5991): Launched 16:29:36.605662 run iperf3-srv_10.42.42.10(pid=5992): Launched 16:29:36.732721 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:29:36.958424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:37.295974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5993): Launched 16:29:37.590379 run iperf3-srv_10.42.42.10(pid=5994): Launched 16:29:37.717582 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:29:37.943316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:38.280494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5995): Launched 16:29:38.574354 run iperf3-srv_10.42.42.10(pid=5996): Launched 16:29:38.702040 tst iperf3m4.py:8: start network... 16:29:38.927130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:39.447049 run create_hlr_db(pid=5997): Launched 16:29:39.575898 bus /gobi_6: Setting Powered False 16:29:40.640730 run create_hlr_db(pid=5997): Terminated: ok {rc=0} 16:29:41.087187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5999): Launched 16:29:41.403000 run osmo-hlr_10.42.42.2(pid=6000): Launched 16:29:41.522500 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:42.099582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6002): Launched 16:29:42.434843 run osmo-stp_10.42.42.5(pid=6003): Launched 16:29:42.563275 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:43.138315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6005): Launched 16:29:43.267804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:43.550751 run patchelf(pid=6006): Launched 16:29:43.736402 run osmo-stp_10.42.42.5(pid=6003): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6003)] 16:29:43.876651 run osmo-stp_10.42.42.5(pid=6003): stdout: | (launched: 2022-12-13_16:29:42.373511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:44.019246 run osmo-stp_10.42.42.5(pid=6003): stderr: | [0;m[38;5;43m20221213162942565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162942565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162942565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162942565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162942566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162942566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162942566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:44.161988 run osmo-stp_10.42.42.5(pid=6003): stdout: | (launched: 2022-12-13_16:29:42.373511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:44.298665 run osmo-stp_10.42.42.5(pid=6003): stderr: | [0;m[38;5;43m20221213162942565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162942565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162942565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162942565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162942566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162942566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162942566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:44.459960 run patchelf(pid=6006): Terminating (SIGINT) 16:29:44.646615 run patchelf(pid=6006): Terminated: ok {rc=0} 16:29:44.781477 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6003): Process ended prematurely: osmo-stp_10.42.42.5(pid=6003) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6003)] [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:29:44.791865 tst iperf3m4.py:8: Test FAILED (11.3 sec) 16:29:44.821153 run osmo-hlr_10.42.42.2(pid=6000): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6000)] 16:29:44.872455 run osmo-hlr_10.42.42.2(pid=6000): stdout: | (launched: 2022-12-13_16:29:41.345120) 16:29:44.924887 run osmo-hlr_10.42.42.2(pid=6000): stderr: | [0;m[1;31m20221213162941520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162941521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162941521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162941521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162941521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162941521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162941533 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162941541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162941542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162941542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:44.978069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5989): Terminating (SIGTERM) 16:29:45.020258 run iperf3-srv_10.42.42.10(pid=5990): Terminating (SIGTERM) 16:29:45.062761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5991): Terminating (SIGTERM) 16:29:45.105748 run iperf3-srv_10.42.42.10(pid=5992): Terminating (SIGTERM) 16:29:45.148260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5993): Terminating (SIGTERM) 16:29:45.191524 run iperf3-srv_10.42.42.10(pid=5994): Terminating (SIGTERM) 16:29:45.233994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5995): Terminating (SIGTERM) 16:29:45.276671 run iperf3-srv_10.42.42.10(pid=5996): Terminating (SIGTERM) 16:29:45.319626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5999): Terminating (SIGTERM) 16:29:45.362454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6002): Terminating (SIGTERM) 16:29:45.405079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6005): Terminating (SIGTERM) 16:29:45.448153 --- ParallelTerminationStrategy: PID 5989 died... 16:29:45.468884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5989): Terminated: ok {rc=0} 16:29:45.515835 --- ParallelTerminationStrategy: PID 5990 died... 16:29:45.536028 run iperf3-srv_10.42.42.10(pid=5990): Terminated {rc=256} 16:29:45.582713 --- ParallelTerminationStrategy: PID 5991 died... 16:29:45.602821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5991): Terminated: ok {rc=0} 16:29:45.649366 --- ParallelTerminationStrategy: PID 5992 died... 16:29:45.669395 run iperf3-srv_10.42.42.10(pid=5992): Terminated {rc=256} 16:29:45.715842 --- ParallelTerminationStrategy: PID 5993 died... 16:29:45.735978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5993): Terminated: ok {rc=0} 16:29:45.782935 --- ParallelTerminationStrategy: PID 5994 died... 16:29:45.803054 run iperf3-srv_10.42.42.10(pid=5994): Terminated {rc=256} 16:29:45.860230 --- ParallelTerminationStrategy: PID 5995 died... 16:29:45.885327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5995): Terminated: ok {rc=0} 16:29:45.933228 --- ParallelTerminationStrategy: PID 5996 died... 16:29:45.954078 run iperf3-srv_10.42.42.10(pid=5996): Terminated {rc=256} 16:29:46.001667 --- ParallelTerminationStrategy: PID 5999 died... 16:29:46.022440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5999): Terminated: ok {rc=0} 16:29:46.070214 --- ParallelTerminationStrategy: PID 6002 died... 16:29:46.091100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6002): Terminated: ok {rc=0} 16:29:46.139020 --- ParallelTerminationStrategy: PID 6005 died... 16:29:46.160158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6005): Terminated: ok {rc=0} 16:29:46.251726 bus /gobi_4: Setting Powered False 16:29:47.352100 bus /gobi_4: Setting Powered False 16:29:48.466811 bus /gobi_1: Setting Powered False 16:29:49.567283 bus /gobi_1: Setting Powered False 16:29:50.684789 bus /gobi_0: Setting Powered False 16:29:51.785068 bus /gobi_0: Setting Powered False 16:29:52.902629 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:29:54.005829 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:54.017627 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:29:54.088677 tst ping.py: using LAC 34845 16:29:54.219420 tst ping.py: using RAC 165 16:29:54.349141 tst ping.py: using CellId 34845 16:29:54.479258 tst ping.py: using BVCI 34846 16:29:54.598923 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:54.610783 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:54.622154 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:54.633730 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:54.645345 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:54.657087 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:54.669374 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:29:54.680894 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:29:54.799497 tst ping.py:19: start network... 16:29:55.004696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:55.480216 run create_hlr_db(pid=6007): Launched 16:29:55.606004 bus /gobi_6: Setting Powered False 16:29:56.667039 run create_hlr_db(pid=6007): Terminated: ok {rc=0} 16:29:57.095257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6009): Launched 16:29:57.404247 run osmo-hlr_10.42.42.2(pid=6010): Launched 16:29:57.522487 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:58.066523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6012): Launched 16:29:58.375871 run osmo-stp_10.42.42.5(pid=6013): Launched 16:29:58.492276 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:59.021510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6015): Launched 16:29:59.138613 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:59.398285 run patchelf(pid=6016): Launched 16:29:59.569079 run osmo-stp_10.42.42.5(pid=6013): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6013)] 16:29:59.698571 run osmo-stp_10.42.42.5(pid=6013): stdout: | (launched: 2022-12-13_16:29:58.319013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:59.830464 run osmo-stp_10.42.42.5(pid=6013): stderr: | [0;m[38;5;43m20221213162958486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162958486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162958487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162958487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162958487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162958488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162958488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:59.962253 run osmo-stp_10.42.42.5(pid=6013): stdout: | (launched: 2022-12-13_16:29:58.319013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:00.087299 run osmo-stp_10.42.42.5(pid=6013): stderr: | [0;m[38;5;43m20221213162958486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213162958486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213162958487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213162958487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213162958487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213162958488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213162958488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:00.235858 run patchelf(pid=6016): Terminating (SIGINT) 16:30:00.407893 run patchelf(pid=6016): Terminated: ok {rc=0} 16:30:00.532121 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6013): Process ended prematurely: osmo-stp_10.42.42.5(pid=6013) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6013)] [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 16:30:00.541345 tst ping.py:22: Test FAILED (6.5 sec) 16:30:00.568613 run osmo-hlr_10.42.42.2(pid=6010): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6010)] 16:30:00.616893 run osmo-hlr_10.42.42.2(pid=6010): stdout: | (launched: 2022-12-13_16:29:57.346960) 16:30:00.667105 run osmo-hlr_10.42.42.2(pid=6010): stderr: | [0;m[1;31m20221213162957522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213162957522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213162957522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213162957522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213162957522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213162957522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213162957534 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213162957542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213162957542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213162957542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:00.717937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6009): Terminating (SIGTERM) 16:30:00.758056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6012): Terminating (SIGTERM) 16:30:00.798683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6015): Terminating (SIGTERM) 16:30:00.849803 --- ParallelTerminationStrategy: PID 6009 died... 16:30:00.871708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6009): Terminated: ok {rc=0} 16:30:00.944367 --- ParallelTerminationStrategy: PID 6012 died... 16:30:00.969459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6012): Terminated: ok {rc=0} 16:30:01.023931 --- ParallelTerminationStrategy: PID 6015 died... 16:30:01.045101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6015): Terminated: ok {rc=0} 16:30:01.146135 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:30:02.257256 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:02.270270 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:30:02.346644 tst ping_idle_ping.py: using LAC 34846 16:30:02.475866 tst ping_idle_ping.py: using RAC 166 16:30:02.605363 tst ping_idle_ping.py: using CellId 34846 16:30:02.736120 tst ping_idle_ping.py: using BVCI 34847 16:30:02.856751 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:02.868578 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:02.880145 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:02.891828 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:02.903974 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:02.916085 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:02.928338 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:02.940363 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:30:03.065605 tst ping_idle_ping.py:24: start network... 16:30:03.272332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:03.753482 run create_hlr_db(pid=6020): Launched 16:30:03.881724 bus /gobi_6: Setting Powered False 16:30:04.943330 run create_hlr_db(pid=6020): Terminated: ok {rc=0} 16:30:05.396344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6022): Launched 16:30:05.729141 run osmo-hlr_10.42.42.2(pid=6023): Launched 16:30:05.854990 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:06.420339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6025): Launched 16:30:06.751359 run osmo-stp_10.42.42.5(pid=6026): Launched 16:30:06.878008 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:30:07.446806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6028): Launched 16:30:07.574858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:30:07.853533 run patchelf(pid=6029): Launched 16:30:08.038410 run osmo-stp_10.42.42.5(pid=6026): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6026)] 16:30:08.178042 run osmo-stp_10.42.42.5(pid=6026): stdout: | (launched: 2022-12-13_16:30:06.690852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:08.320134 run osmo-stp_10.42.42.5(pid=6026): stderr: | [0;m[38;5;43m20221213163006880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163006880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163006880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163006881 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163006881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163006881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163006881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:08.461479 run osmo-stp_10.42.42.5(pid=6026): stdout: | (launched: 2022-12-13_16:30:06.690852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:08.596156 run osmo-stp_10.42.42.5(pid=6026): stderr: | [0;m[38;5;43m20221213163006880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163006880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163006880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163006881 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163006881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163006881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163006881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:08.755931 run patchelf(pid=6029): Terminating (SIGINT) 16:30:08.940460 run patchelf(pid=6029): Terminated: ok {rc=0} 16:30:09.073065 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6026): Process ended prematurely: osmo-stp_10.42.42.5(pid=6026) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6026)] [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:30:09.082747 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:30:09.111468 run osmo-hlr_10.42.42.2(pid=6023): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6023)] 16:30:09.163058 run osmo-hlr_10.42.42.2(pid=6023): stdout: | (launched: 2022-12-13_16:30:05.668264) 16:30:09.216368 run osmo-hlr_10.42.42.2(pid=6023): stderr: | [0;m[1;31m20221213163005866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163005866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163005866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163005866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163005866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163005866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163005878 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163005888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163005888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163005888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:09.269614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6022): Terminating (SIGTERM) 16:30:09.312129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6025): Terminating (SIGTERM) 16:30:09.355457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6028): Terminating (SIGTERM) 16:30:09.398890 --- ParallelTerminationStrategy: PID 6022 died... 16:30:09.420012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6022): Terminated: ok {rc=0} 16:30:09.467683 --- ParallelTerminationStrategy: PID 6025 died... 16:30:09.488366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6025): Terminated: ok {rc=0} 16:30:09.535889 --- ParallelTerminationStrategy: PID 6028 died... 16:30:09.556395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6028): Terminated: ok {rc=0} 16:30:09.647059 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:30:10.960278 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:30:10.966979 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:30:11.001760 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:30:11.042384 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:30:11.133695 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:30:11.168598 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:30:11.209516 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:30:11.807020 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:30:11.861539 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:11.872887 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:30:11.945399 tst cs_paging_gprs_active.py: using LAC 34847 16:30:12.074235 tst cs_paging_gprs_active.py: using RAC 167 16:30:12.203510 tst cs_paging_gprs_active.py: using CellId 34847 16:30:12.332465 tst cs_paging_gprs_active.py: using BVCI 34848 16:30:12.454351 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:12.465821 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:12.477065 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:12.488241 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:12.499808 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:12.511474 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:12.523288 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:12.534885 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:12.546699 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:30:12.667208 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:30:12.795998 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:30:13.023782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:13.361666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6033): Launched 16:30:13.656496 run iperf3-srv_10.42.42.10(pid=6034): Launched 16:30:13.783590 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:30:14.010389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:14.348365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6035): Launched 16:30:14.643592 run iperf3-srv_10.42.42.10(pid=6036): Launched 16:30:14.771562 tst cs_paging_gprs_active.py:38: start network... 16:30:14.998317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:15.520690 run create_hlr_db(pid=6037): Launched 16:30:15.650801 bus /gobi_6: Setting Powered False 16:30:16.718246 run create_hlr_db(pid=6037): Terminated: ok {rc=0} 16:30:17.204056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Launched 16:30:17.542449 run osmo-hlr_10.42.42.2(pid=6040): Launched 16:30:17.673281 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:18.251621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Launched 16:30:18.591010 run osmo-stp_10.42.42.5(pid=6043): Launched 16:30:18.719637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:30:19.299203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Launched 16:30:19.430348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:30:19.714982 run patchelf(pid=6047): Launched 16:30:19.903712 run osmo-stp_10.42.42.5(pid=6043): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] 16:30:20.045680 run osmo-stp_10.42.42.5(pid=6043): stdout: | (launched: 2022-12-13_16:30:18.528850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:20.189197 run osmo-stp_10.42.42.5(pid=6043): stderr: | [0;m[38;5;43m20221213163018720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163018720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163018720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163018721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163018721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163018721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163018721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:20.333756 run osmo-stp_10.42.42.5(pid=6043): stdout: | (launched: 2022-12-13_16:30:18.528850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:20.470731 run osmo-stp_10.42.42.5(pid=6043): stderr: | [0;m[38;5;43m20221213163018720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163018720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163018720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163018721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163018721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163018721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163018721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:20.633738 run patchelf(pid=6047): Terminating (SIGINT) 16:30:20.821885 run patchelf(pid=6047): Terminated: ok {rc=0} 16:30:20.957256 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6043): Process ended prematurely: osmo-stp_10.42.42.5(pid=6043) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:30:20.967614 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 16:30:20.996582 run osmo-hlr_10.42.42.2(pid=6040): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6040)] 16:30:21.048212 run osmo-hlr_10.42.42.2(pid=6040): stdout: | (launched: 2022-12-13_16:30:17.480274) 16:30:21.100850 run osmo-hlr_10.42.42.2(pid=6040): stderr: | [0;m[1;31m20221213163017677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163017677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163017677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163017678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163017678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163017678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163017690 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163017698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163017699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163017699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:21.153780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6033): Terminating (SIGTERM) 16:30:21.196046 run iperf3-srv_10.42.42.10(pid=6034): Terminating (SIGTERM) 16:30:21.239335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6035): Terminating (SIGTERM) 16:30:21.282121 run iperf3-srv_10.42.42.10(pid=6036): Terminating (SIGTERM) 16:30:21.324423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Terminating (SIGTERM) 16:30:21.367002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Terminating (SIGTERM) 16:30:21.409467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Terminating (SIGTERM) 16:30:21.452223 --- ParallelTerminationStrategy: PID 6033 died... 16:30:21.473033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6033): Terminated: ok {rc=0} 16:30:21.520422 --- ParallelTerminationStrategy: PID 6034 died... 16:30:21.540936 run iperf3-srv_10.42.42.10(pid=6034): Terminated {rc=256} 16:30:21.587862 --- ParallelTerminationStrategy: PID 6035 died... 16:30:21.608121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6035): Terminated: ok {rc=0} 16:30:21.655010 --- ParallelTerminationStrategy: PID 6036 died... 16:30:21.675213 run iperf3-srv_10.42.42.10(pid=6036): Terminated {rc=256} 16:30:21.721951 --- ParallelTerminationStrategy: PID 6039 died... 16:30:21.742211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Terminated: ok {rc=0} 16:30:21.789271 --- ParallelTerminationStrategy: PID 6042 died... 16:30:21.809583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Terminated: ok {rc=0} 16:30:21.856457 --- ParallelTerminationStrategy: PID 6045 died... 16:30:21.876503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Terminated: ok {rc=0} 16:30:21.965644 bus /gobi_0: Setting Powered False 16:30:23.065832 bus /gobi_0: Setting Powered False 16:30:24.185359 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:30:25.337293 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:25.350021 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:30:25.424758 tst iperf3.py: using LAC 34848 16:30:25.557167 tst iperf3.py: using RAC 168 16:30:25.689362 tst iperf3.py: using CellId 34848 16:30:25.820261 tst iperf3.py: using BVCI 34849 16:30:25.942590 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:25.954077 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:25.965494 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:25.977023 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:25.988592 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:26.000251 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:26.012057 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:26.023674 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:26.035587 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:30:26.159357 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:30:26.386714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:26.724235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6048): Launched 16:30:27.018478 run iperf3-srv_10.42.42.10(pid=6049): Launched 16:30:27.145150 tst iperf3.py:8: start network... 16:30:27.371972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:27.893518 run create_hlr_db(pid=6050): Launched 16:30:28.023897 bus /gobi_6: Setting Powered False 16:30:29.089458 run create_hlr_db(pid=6050): Terminated: ok {rc=0} 16:30:29.537928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6052): Launched 16:30:29.854605 run osmo-hlr_10.42.42.2(pid=6053): Launched 16:30:29.976834 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:30.534771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6055): Launched 16:30:30.865738 run osmo-stp_10.42.42.5(pid=6056): Launched 16:30:31.145379 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:30:31.731523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6058): Launched 16:30:31.865210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:30:32.134874 run patchelf(pid=6059): Launched 16:30:32.324237 run osmo-stp_10.42.42.5(pid=6056): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6056)] 16:30:32.456808 run osmo-stp_10.42.42.5(pid=6056): stdout: | (launched: 2022-12-13_16:30:30.790489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:32.591390 run osmo-stp_10.42.42.5(pid=6056): stderr: | [0;m[38;5;43m20221213163030986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163030986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163030987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163030987 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163030988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163030988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163030988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:32.726251 run osmo-stp_10.42.42.5(pid=6056): stdout: | (launched: 2022-12-13_16:30:30.790489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:32.853917 run osmo-stp_10.42.42.5(pid=6056): stderr: | [0;m[38;5;43m20221213163030986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163030986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163030987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163030987 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163030988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163030988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163030988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:33.005799 run patchelf(pid=6059): Terminating (SIGINT) 16:30:33.182282 run patchelf(pid=6059): Terminated: ok {rc=0} 16:30:33.309128 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6056): Process ended prematurely: osmo-stp_10.42.42.5(pid=6056) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6056)] [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 16:30:33.318830 tst iperf3.py:8: Test FAILED (8.0 sec) 16:30:33.346747 run osmo-hlr_10.42.42.2(pid=6053): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6053)] 16:30:33.395191 run osmo-hlr_10.42.42.2(pid=6053): stdout: | (launched: 2022-12-13_16:30:29.796038) 16:30:33.445694 run osmo-hlr_10.42.42.2(pid=6053): stderr: | [0;m[1;31m20221213163029973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163029973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163029973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163029974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163029974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163029974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163029986 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163029994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163029995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163029995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:33.496215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6048): Terminating (SIGTERM) 16:30:33.536826 run iperf3-srv_10.42.42.10(pid=6049): Terminating (SIGTERM) 16:30:33.577250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6052): Terminating (SIGTERM) 16:30:33.618433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6055): Terminating (SIGTERM) 16:30:33.659187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6058): Terminating (SIGTERM) 16:30:33.700034 --- ParallelTerminationStrategy: PID 6048 died... 16:30:33.719389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6048): Terminated: ok {rc=0} 16:30:33.764005 --- ParallelTerminationStrategy: PID 6049 died... 16:30:33.785862 run iperf3-srv_10.42.42.10(pid=6049): Terminated {rc=256} 16:30:33.830069 --- ParallelTerminationStrategy: PID 6052 died... 16:30:33.848749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6052): Terminated: ok {rc=0} 16:30:33.893387 --- ParallelTerminationStrategy: PID 6055 died... 16:30:33.912383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6055): Terminated: ok {rc=0} 16:30:33.956702 --- ParallelTerminationStrategy: PID 6058 died... 16:30:33.975601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6058): Terminated: ok {rc=0} 16:30:34.061514 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:30:35.210816 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:35.222664 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:30:35.295630 tst iperf3m4.py: using LAC 34849 16:30:35.420371 tst iperf3m4.py: using RAC 169 16:30:35.544919 tst iperf3m4.py: using CellId 34849 16:30:35.670872 tst iperf3m4.py: using BVCI 34850 16:30:35.787101 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:35.798169 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:35.809059 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:35.819923 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:35.831119 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:35.842487 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:35.854049 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:35.865439 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:35.876863 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:30:36.001702 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:30:36.124036 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:30:36.247385 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:30:36.367726 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:30:36.578516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:36.894482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6060): Launched 16:30:37.171663 run iperf3-srv_10.42.42.10(pid=6061): Launched 16:30:37.290082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:30:37.500672 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:37.818339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6062): Launched 16:30:38.094977 run iperf3-srv_10.42.42.10(pid=6063): Launched 16:30:38.214483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:30:38.424222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:38.739745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6064): Launched 16:30:39.014477 run iperf3-srv_10.42.42.10(pid=6065): Launched 16:30:39.133670 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:30:39.343862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:39.659568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6066): Launched 16:30:39.935320 run iperf3-srv_10.42.42.10(pid=6067): Launched 16:30:40.054851 tst iperf3m4.py:8: start network... 16:30:40.264677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:40.750803 run create_hlr_db(pid=6068): Launched 16:30:40.878878 bus /gobi_6: Setting Powered False 16:30:41.940798 run create_hlr_db(pid=6068): Terminated: ok {rc=0} 16:30:42.397676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6070): Launched 16:30:42.733967 run osmo-hlr_10.42.42.2(pid=6071): Launched 16:30:42.862839 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:43.444924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6073): Launched 16:30:43.780657 run osmo-stp_10.42.42.5(pid=6074): Launched 16:30:43.909399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:30:44.487399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6076): Launched 16:30:44.617128 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:30:44.900711 run patchelf(pid=6077): Launched 16:30:45.088511 run osmo-stp_10.42.42.5(pid=6074): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6074)] 16:30:45.230256 run osmo-stp_10.42.42.5(pid=6074): stdout: | (launched: 2022-12-13_16:30:43.718918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:45.373835 run osmo-stp_10.42.42.5(pid=6074): stderr: | [0;m[38;5;43m20221213163043910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163043910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163043911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163043911 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163043911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163043911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163043912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:45.517320 run osmo-stp_10.42.42.5(pid=6074): stdout: | (launched: 2022-12-13_16:30:43.718918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:45.654526 run osmo-stp_10.42.42.5(pid=6074): stderr: | [0;m[38;5;43m20221213163043910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163043910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163043911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163043911 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163043911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163043911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163043912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:45.817070 run patchelf(pid=6077): Terminating (SIGINT) 16:30:46.043984 run patchelf(pid=6077): Terminated: ok {rc=0} 16:30:46.183169 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6074): Process ended prematurely: osmo-stp_10.42.42.5(pid=6074) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6074)] [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:30:46.194697 tst iperf3m4.py:8: Test FAILED (11.0 sec) 16:30:46.226875 run osmo-hlr_10.42.42.2(pid=6071): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6071)] 16:30:46.280914 run osmo-hlr_10.42.42.2(pid=6071): stdout: | (launched: 2022-12-13_16:30:42.672159) 16:30:46.335854 run osmo-hlr_10.42.42.2(pid=6071): stderr: | [0;m[1;31m20221213163042869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163042869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163042869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163042869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163042869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163042869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163042882 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163042892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163042893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163042893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:46.391569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6060): Terminating (SIGTERM) 16:30:46.436124 run iperf3-srv_10.42.42.10(pid=6061): Terminating (SIGTERM) 16:30:46.483637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6062): Terminating (SIGTERM) 16:30:46.529068 run iperf3-srv_10.42.42.10(pid=6063): Terminating (SIGTERM) 16:30:46.576836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6064): Terminating (SIGTERM) 16:30:46.622110 run iperf3-srv_10.42.42.10(pid=6065): Terminating (SIGTERM) 16:30:46.670027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6066): Terminating (SIGTERM) 16:30:46.715585 run iperf3-srv_10.42.42.10(pid=6067): Terminating (SIGTERM) 16:30:46.763661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6070): Terminating (SIGTERM) 16:30:46.808661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6073): Terminating (SIGTERM) 16:30:46.853618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6076): Terminating (SIGTERM) 16:30:46.898979 --- ParallelTerminationStrategy: PID 6060 died... 16:30:46.921233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6060): Terminated: ok {rc=0} 16:30:46.971700 --- ParallelTerminationStrategy: PID 6061 died... 16:30:46.992768 run iperf3-srv_10.42.42.10(pid=6061): Terminated {rc=256} 16:30:47.042931 --- ParallelTerminationStrategy: PID 6062 died... 16:30:47.063862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6062): Terminated: ok {rc=0} 16:30:47.114020 --- ParallelTerminationStrategy: PID 6063 died... 16:30:47.134998 run iperf3-srv_10.42.42.10(pid=6063): Terminated {rc=256} 16:30:47.185479 --- ParallelTerminationStrategy: PID 6064 died... 16:30:47.205606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6064): Terminated: ok {rc=0} 16:30:47.253971 --- ParallelTerminationStrategy: PID 6065 died... 16:30:47.274938 run iperf3-srv_10.42.42.10(pid=6065): Terminated {rc=256} 16:30:47.322493 --- ParallelTerminationStrategy: PID 6066 died... 16:30:47.343097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6066): Terminated: ok {rc=0} 16:30:47.390774 --- ParallelTerminationStrategy: PID 6067 died... 16:30:47.411284 run iperf3-srv_10.42.42.10(pid=6067): Terminated {rc=256} 16:30:47.458781 --- ParallelTerminationStrategy: PID 6070 died... 16:30:47.479416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6070): Terminated: ok {rc=0} 16:30:47.527082 --- ParallelTerminationStrategy: PID 6073 died... 16:30:47.547701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6073): Terminated: ok {rc=0} 16:30:47.595265 --- ParallelTerminationStrategy: PID 6076 died... 16:30:47.615972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6076): Terminated: ok {rc=0} 16:30:47.707076 bus /gobi_4: Setting Powered False 16:30:48.808762 bus /gobi_4: Setting Powered False 16:30:49.927580 bus /gobi_1: Setting Powered False 16:30:51.027970 bus /gobi_1: Setting Powered False 16:30:52.145388 bus /gobi_0: Setting Powered False 16:30:53.244208 bus /gobi_0: Setting Powered False 16:30:54.362862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:30:55.466619 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:55.478924 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:30:55.556919 tst ping.py: using LAC 34850 16:30:55.688549 tst ping.py: using RAC 170 16:30:55.821895 tst ping.py: using CellId 34850 16:30:55.950941 tst ping.py: using BVCI 34851 16:30:56.070826 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:56.082465 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:56.093938 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:56.105500 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:56.119785 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:56.131155 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:56.143961 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:30:56.155594 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:30:56.291553 tst ping.py:19: start network... 16:30:56.497666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:56.973470 run create_hlr_db(pid=6085): Launched 16:30:57.099399 bus /gobi_6: Setting Powered False 16:30:58.160241 run create_hlr_db(pid=6085): Terminated: ok {rc=0} 16:30:58.611330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6087): Launched 16:30:58.943535 run osmo-hlr_10.42.42.2(pid=6088): Launched 16:30:59.071220 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:59.645697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6090): Launched 16:30:59.977359 run osmo-stp_10.42.42.5(pid=6091): Launched 16:31:00.103941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:31:00.673012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6093): Launched 16:31:00.801022 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:31:01.091310 run patchelf(pid=6095): Launched 16:31:01.289983 run osmo-stp_10.42.42.5(pid=6091): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6091)] 16:31:01.426680 run osmo-stp_10.42.42.5(pid=6091): stdout: | (launched: 2022-12-13_16:30:59.915999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:01.562872 run osmo-stp_10.42.42.5(pid=6091): stderr: | [0;m[38;5;43m20221213163100107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163100107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163100107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163100108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163100108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163100108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163100109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:01.700051 run osmo-stp_10.42.42.5(pid=6091): stdout: | (launched: 2022-12-13_16:30:59.915999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:01.830217 run osmo-stp_10.42.42.5(pid=6091): stderr: | [0;m[38;5;43m20221213163100107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163100107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163100107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163100108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163100108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163100108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163100109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:01.985871 run patchelf(pid=6095): Terminating (SIGINT) 16:31:02.165422 run patchelf(pid=6095): Terminated: ok {rc=0} 16:31:02.296736 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6091): Process ended prematurely: osmo-stp_10.42.42.5(pid=6091) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6091)] [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 16:31:02.306537 tst ping.py:22: Test FAILED (6.8 sec) 16:31:02.336779 run osmo-hlr_10.42.42.2(pid=6088): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6088)] 16:31:02.388665 run osmo-hlr_10.42.42.2(pid=6088): stdout: | (launched: 2022-12-13_16:30:58.882826) 16:31:02.441690 run osmo-hlr_10.42.42.2(pid=6088): stderr: | [0;m[1;31m20221213163059078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163059078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163059078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163059079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163059079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163059079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163059091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163059102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163059102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163059102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:02.495129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6087): Terminating (SIGTERM) 16:31:02.537536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6090): Terminating (SIGTERM) 16:31:02.580402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6093): Terminating (SIGTERM) 16:31:02.623880 --- ParallelTerminationStrategy: PID 6087 died... 16:31:02.644876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6087): Terminated: ok {rc=0} 16:31:02.692243 --- ParallelTerminationStrategy: PID 6090 died... 16:31:02.712543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6090): Terminated: ok {rc=0} 16:31:02.759614 --- ParallelTerminationStrategy: PID 6093 died... 16:31:02.779665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6093): Terminated: ok {rc=0} 16:31:02.869650 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:31:03.957900 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:03.970396 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:31:04.045409 tst ping_idle_ping.py: using LAC 34851 16:31:04.174657 tst ping_idle_ping.py: using RAC 171 16:31:04.303009 tst ping_idle_ping.py: using CellId 34851 16:31:04.432536 tst ping_idle_ping.py: using BVCI 34852 16:31:04.553947 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:04.565470 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:04.576660 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:04.588173 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:04.599797 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:04.611445 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:04.623388 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:04.635076 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:31:04.755415 tst ping_idle_ping.py:24: start network... 16:31:04.962746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:05.444505 run create_hlr_db(pid=6096): Launched 16:31:05.571798 bus /gobi_6: Setting Powered False 16:31:06.633420 run create_hlr_db(pid=6096): Terminated: ok {rc=0} 16:31:07.065712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6098): Launched 16:31:07.375911 run osmo-hlr_10.42.42.2(pid=6099): Launched 16:31:07.493956 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:08.037890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6101): Launched 16:31:08.348604 run osmo-stp_10.42.42.5(pid=6102): Launched 16:31:08.465293 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:31:08.996379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6104): Launched 16:31:09.116560 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:31:09.377690 run patchelf(pid=6105): Launched 16:31:09.549752 run osmo-stp_10.42.42.5(pid=6102): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6102)] 16:31:09.682186 run osmo-stp_10.42.42.5(pid=6102): stdout: | (launched: 2022-12-13_16:31:08.291241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:09.814921 run osmo-stp_10.42.42.5(pid=6102): stderr: | [0;m[38;5;43m20221213163108461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163108462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163108462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163108462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163108463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163108463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163108463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:09.948373 run osmo-stp_10.42.42.5(pid=6102): stdout: | (launched: 2022-12-13_16:31:08.291241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:10.074432 run osmo-stp_10.42.42.5(pid=6102): stderr: | [0;m[38;5;43m20221213163108461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163108462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163108462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163108462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163108463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163108463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163108463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:10.223911 run patchelf(pid=6105): Terminating (SIGINT) 16:31:10.397342 run patchelf(pid=6105): Terminated: ok {rc=0} 16:31:10.521875 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6102): Process ended prematurely: osmo-stp_10.42.42.5(pid=6102) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6102)] [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:31:10.530816 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:31:10.558281 run osmo-hlr_10.42.42.2(pid=6099): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6099)] 16:31:10.606683 run osmo-hlr_10.42.42.2(pid=6099): stdout: | (launched: 2022-12-13_16:31:07.318232) 16:31:10.656696 run osmo-hlr_10.42.42.2(pid=6099): stderr: | [0;m[1;31m20221213163107492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163107492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163107492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163107492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163107492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163107492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163107504 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163107513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163107513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163107513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:10.707379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6098): Terminating (SIGTERM) 16:31:10.747538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6101): Terminating (SIGTERM) 16:31:10.788192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6104): Terminating (SIGTERM) 16:31:10.829047 --- ParallelTerminationStrategy: PID 6098 died... 16:31:10.848460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6098): Terminated: ok {rc=0} 16:31:10.893306 --- ParallelTerminationStrategy: PID 6101 died... 16:31:10.912416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6101): Terminated: ok {rc=0} 16:31:10.957293 --- ParallelTerminationStrategy: PID 6104 died... 16:31:10.976328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6104): Terminated: ok {rc=0} 16:31:11.063907 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:31:12.378553 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:12.386184 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:31:12.421418 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:31:12.457663 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:31:12.514317 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:31:12.549008 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:31:12.585325 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:31:13.146036 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:31:13.152433 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:31:13.165244 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:31:13.238722 tst switch_tch_pdch.py: using LAC 34852 16:31:13.366938 tst switch_tch_pdch.py: using RAC 172 16:31:13.493376 tst switch_tch_pdch.py: using CellId 34852 16:31:13.620073 tst switch_tch_pdch.py: using BVCI 34853 16:31:13.739627 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:31:13.751407 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:31:13.763088 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:31:13.774863 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:31:13.786879 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:31:13.798821 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:31:13.810944 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:31:13.822964 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:31:13.940813 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:31:14.065446 tst switch_tch_pdch.py:51: start network... 16:31:14.272455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:14.748442 run create_hlr_db(pid=6109): Launched 16:31:14.874367 bus /gobi_6: Setting Powered False 16:31:15.943213 run create_hlr_db(pid=6109): Terminated: ok {rc=0} 16:31:16.397280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6111): Launched 16:31:16.720216 run osmo-hlr_10.42.42.2(pid=6112): Launched 16:31:16.844226 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:17.465798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6114): Launched 16:31:17.773698 run osmo-stp_10.42.42.5(pid=6115): Launched 16:31:17.890182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:31:18.419096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6117): Launched 16:31:18.536439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:31:18.795198 run patchelf(pid=6118): Launched 16:31:18.967622 run osmo-stp_10.42.42.5(pid=6115): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6115)] 16:31:19.097034 run osmo-stp_10.42.42.5(pid=6115): stdout: | (launched: 2022-12-13_16:31:17.716455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:19.228098 run osmo-stp_10.42.42.5(pid=6115): stderr: | [0;m[38;5;43m20221213163117885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163117885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163117886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163117886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163117886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163117887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163117887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:19.360041 run osmo-stp_10.42.42.5(pid=6115): stdout: | (launched: 2022-12-13_16:31:17.716455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:19.485124 run osmo-stp_10.42.42.5(pid=6115): stderr: | [0;m[38;5;43m20221213163117885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163117885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163117886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163117886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163117886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163117887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163117887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:19.633878 run patchelf(pid=6118): Terminating (SIGINT) 16:31:19.805597 run patchelf(pid=6118): Terminated: ok {rc=0} 16:31:19.929819 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6115): Process ended prematurely: osmo-stp_10.42.42.5(pid=6115) [trial-2391↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6115)] [trial-2391↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:31:19.938795 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 16:31:19.965698 run osmo-hlr_10.42.42.2(pid=6112): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6112)] 16:31:20.014130 run osmo-hlr_10.42.42.2(pid=6112): stdout: | (launched: 2022-12-13_16:31:16.662905) 16:31:20.063752 run osmo-hlr_10.42.42.2(pid=6112): stderr: | [0;m[1;31m20221213163117065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163117065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163117065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163117065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163117065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163117066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163117087 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163117099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163117099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163117100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:20.113962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6111): Terminating (SIGTERM) 16:31:20.154037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6114): Terminating (SIGTERM) 16:31:20.194562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6117): Terminating (SIGTERM) 16:31:20.234836 --- ParallelTerminationStrategy: PID 6111 died... 16:31:20.253968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6111): Terminated: ok {rc=0} 16:31:20.298014 --- ParallelTerminationStrategy: PID 6114 died... 16:31:20.316488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6114): Terminated: ok {rc=0} 16:31:20.360687 --- ParallelTerminationStrategy: PID 6117 died... 16:31:20.379444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6117): Terminated: ok {rc=0} 16:31:20.465157 bus /gobi_0: Setting Powered False 16:31:21.564695 bus /gobi_0: Setting Powered False 16:31:22.679465 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:31:23.931398 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:23.937676 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:31:23.970854 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:31:24.005860 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:31:24.063884 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:31:24.098425 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:31:24.133115 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:31:24.682822 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:31:24.688856 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:31:24.700424 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:31:24.770250 tst switch_tch_pdch.py: using LAC 34853 16:31:24.891850 tst switch_tch_pdch.py: using RAC 173 16:31:25.012664 tst switch_tch_pdch.py: using CellId 34853 16:31:25.135488 tst switch_tch_pdch.py: using BVCI 34854 16:31:25.247897 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:31:25.259055 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:31:25.269884 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:31:25.280637 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:31:25.291409 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:31:25.302285 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:31:25.313326 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:31:25.324119 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:31:25.445101 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:31:25.563160 tst switch_tch_pdch.py:51: start network... 16:31:25.768091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:26.216784 run create_hlr_db(pid=6122): Launched 16:31:26.341602 bus /gobi_6: Setting Powered False 16:31:27.402729 run create_hlr_db(pid=6122): Terminated: ok {rc=0} 16:31:27.803859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6124): Launched 16:31:28.112427 run osmo-hlr_10.42.42.2(pid=6125): Launched 16:31:28.229475 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:28.730009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6127): Launched 16:31:29.038107 run osmo-stp_10.42.42.5(pid=6128): Launched 16:31:29.154595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:31:29.655802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6130): Launched 16:31:29.774856 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:31:30.033253 run patchelf(pid=6131): Launched 16:31:30.204177 run osmo-stp_10.42.42.5(pid=6128): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6128)] 16:31:30.333307 run osmo-stp_10.42.42.5(pid=6128): stdout: | (launched: 2022-12-13_16:31:28.981260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:30.464368 run osmo-stp_10.42.42.5(pid=6128): stderr: | [0;m[38;5;43m20221213163129150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163129150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163129150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163129151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163129151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163129151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163129151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:30.595713 run osmo-stp_10.42.42.5(pid=6128): stdout: | (launched: 2022-12-13_16:31:28.981260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:30.720617 run osmo-stp_10.42.42.5(pid=6128): stderr: | [0;m[38;5;43m20221213163129150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163129150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163129150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163129151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163129151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163129151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163129151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:30.874942 run patchelf(pid=6131): Terminating (SIGINT) 16:31:31.058751 run patchelf(pid=6131): Terminated: ok {rc=0} 16:31:31.184751 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6128): Process ended prematurely: osmo-stp_10.42.42.5(pid=6128) [trial-2391↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6128)] [trial-2391↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:31:31.194726 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:31:31.222457 run osmo-hlr_10.42.42.2(pid=6125): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6125)] 16:31:31.271583 run osmo-hlr_10.42.42.2(pid=6125): stdout: | (launched: 2022-12-13_16:31:28.054842) 16:31:31.322397 run osmo-hlr_10.42.42.2(pid=6125): stderr: | [0;m[1;31m20221213163128230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163128230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163128230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163128230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163128231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163128231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163128242 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163128251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163128251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163128251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:31.373694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6124): Terminating (SIGTERM) 16:31:31.414839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6127): Terminating (SIGTERM) 16:31:31.457371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6130): Terminating (SIGTERM) 16:31:31.498573 --- ParallelTerminationStrategy: PID 6124 died... 16:31:31.517700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6124): Terminated: ok {rc=0} 16:31:31.562926 --- ParallelTerminationStrategy: PID 6127 died... 16:31:31.582252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6127): Terminated: ok {rc=0} 16:31:31.627431 --- ParallelTerminationStrategy: PID 6130 died... 16:31:31.646931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6130): Terminated: ok {rc=0} 16:31:31.733483 bus /gobi_0: Setting Powered False 16:31:32.833193 bus /gobi_0: Setting Powered False 16:31:33.954663 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 16:31:35.210403 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:35.214830 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:31:35.243855 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 16:31:35.250754 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:31:35.304821 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:31:35.335205 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 16:31:35.342154 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:31:35.879039 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 16:31:35.884345 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 16:31:35.895723 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:31:35.939828 tst mo_mt_sms.py: using LAC 34854 16:31:36.059978 tst mo_mt_sms.py: using RAC 174 16:31:36.182122 tst mo_mt_sms.py: using CellId 34854 16:31:36.301332 tst mo_mt_sms.py: using BVCI 34855 16:31:36.411840 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:31:36.532023 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:31:36.647930 tst mo_mt_sms.py:9: start nitb and bts... 16:31:36.854988 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:31:37.480660 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6135): Launched 16:31:37.789793 run osmo-nitb_10.42.42.2(pid=6136): Launched 16:31:37.960122 run osmo-nitb_10.42.42.2(pid=6136): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6136)] 16:31:38.097714 run osmo-nitb_10.42.42.2(pid=6136): stdout: | (launched: 2022-12-13_16:31:37.732536) 16:31:38.237413 run osmo-nitb_10.42.42.2(pid=6136): stderr: | (launched: 2022-12-13_16:31:37.778323) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:31:38.376501 run osmo-nitb_10.42.42.2(pid=6136): stdout: | (launched: 2022-12-13_16:31:37.732536) 16:31:38.509397 run osmo-nitb_10.42.42.2(pid=6136): stderr: | (launched: 2022-12-13_16:31:37.778323) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6136): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6136) [trial-2391↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6136)] 16:31:38.905897 tst osmo-nitb_10.42.42.2(pid=6136): stdout: | (launched: 2022-12-13_16:31:37.732536) 16:31:39.030220 tst osmo-nitb_10.42.42.2(pid=6136): stderr: | (launched: 2022-12-13_16:31:37.778323) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:31:39.176339 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6136): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6136) [trial-2391↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6136)] [trial-2391↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 16:31:39.185125 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 16:31:39.191979 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6135): Terminating (SIGTERM) 16:31:39.401116 --- ParallelTerminationStrategy: PID 6135 died... 16:31:39.421813 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6135): Terminated: ok {rc=0} 16:31:39.509626 bus /sierra_3: Setting Powered False 16:31:40.613154 bus /sierra_3: Setting Powered False 16:31:41.733680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 16:31:42.927340 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:42.931401 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:31:42.960599 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:31:42.987483 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:31:43.038884 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:31:43.068331 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:31:43.095170 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:31:43.647919 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 16:31:43.654083 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:31:43.665158 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:31:43.709946 tst mo_mt_sms.py: using LAC 34855 16:31:43.838275 tst mo_mt_sms.py: using RAC 175 16:31:43.968355 tst mo_mt_sms.py: using CellId 34855 16:31:44.097649 tst mo_mt_sms.py: using BVCI 34856 16:31:44.226543 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:31:44.238094 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:31:44.249925 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:31:44.261297 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:31:44.272844 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:31:44.284502 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:31:44.404080 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:31:44.524666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:45.035635 run create_hlr_db(pid=6140): Launched 16:31:45.161466 bus /sierra_2: Setting Powered False 16:31:46.227406 run create_hlr_db(pid=6140): Terminated: ok {rc=0} 16:31:46.684050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6142): Launched 16:31:47.017731 run osmo-hlr_10.42.42.2(pid=6143): Launched 16:31:47.229601 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:47.795623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6145): Launched 16:31:48.128472 run osmo-stp_10.42.42.5(pid=6146): Launched 16:31:48.256719 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:48.856262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6148): Launched 16:31:49.189206 run osmo-msc_10.42.42.6(pid=6149): Launched 16:31:49.373297 run osmo-stp_10.42.42.5(pid=6146): ERR: Terminated: ERROR {rc=1} [trial-2391↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6146)] 16:31:49.512025 run osmo-stp_10.42.42.5(pid=6146): stdout: | (launched: 2022-12-13_16:31:48.066934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:49.651079 run osmo-stp_10.42.42.5(pid=6146): stderr: | [0;m[38;5;43m20221213163148260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163148260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163148260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163148261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163148261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163148261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163148261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:49.788633 run osmo-stp_10.42.42.5(pid=6146): stdout: | (launched: 2022-12-13_16:31:48.066934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:49.919713 run osmo-stp_10.42.42.5(pid=6146): stderr: | [0;m[38;5;43m20221213163148260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163148260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163148260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163148261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163148261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163148261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163148261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:50.076449 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6146): Process ended prematurely: osmo-stp_10.42.42.5(pid=6146) [trial-2391↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6146)] [trial-2391↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 16:31:50.085938 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 16:31:50.114260 run osmo-hlr_10.42.42.2(pid=6143): ERR: Terminated: ERROR {rc=237} [trial-2391↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6143)] 16:31:50.166365 run osmo-hlr_10.42.42.2(pid=6143): stdout: | (launched: 2022-12-13_16:31:46.955999) 16:31:50.219554 run osmo-hlr_10.42.42.2(pid=6143): stderr: | [0;m[1;31m20221213163147218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163147218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163147218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163147218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163147219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163147219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163147231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163147239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163147239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163147239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:50.294110 run osmo-msc_10.42.42.6(pid=6149): ERR: Terminated: ERROR {rc=2} [trial-2391↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6149)] 16:31:50.345553 run osmo-msc_10.42.42.6(pid=6149): stdout: | (launched: 2022-12-13_16:31:49.128110) 16:31:50.398205 run osmo-msc_10.42.42.6(pid=6149): stderr: | [0;m[38;5;43m20221213163149449 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163149449 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1c0e515c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163149450 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163149450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163149450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163149450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163149452 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163149452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163149452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163149452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:50.451261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6142): Terminating (SIGTERM) 16:31:50.493648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6145): Terminating (SIGTERM) 16:31:50.536552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6148): Terminating (SIGTERM) 16:31:50.579985 --- ParallelTerminationStrategy: PID 6142 died... 16:31:50.600542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6142): Terminated: ok {rc=0} 16:31:50.648061 --- ParallelTerminationStrategy: PID 6145 died... 16:31:50.668166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6145): Terminated: ok {rc=0} 16:31:50.715539 --- ParallelTerminationStrategy: PID 6148 died... 16:31:50.735869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6148): Terminated: ok {rc=0} 16:31:50.826760 bus /sierra_3: Setting Powered False 16:31:51.926881 bus /sierra_3: Setting Powered False 16:31:53.045909 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 16:31:54.286692 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:54.291371 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:31:54.320774 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 16:31:54.328024 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 16:31:54.367758 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:31:54.397396 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 16:31:54.404099 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 16:31:54.919702 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2391 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 16:31:54.925147 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 16:31:54.936075 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:31:54.979895 tst assert_extension.py: using LAC 34856 16:31:55.101563 tst assert_extension.py: using RAC 176 16:31:55.223642 tst assert_extension.py: using CellId 34856 16:31:55.342793 tst assert_extension.py: using BVCI 34857 16:31:55.452795 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 16:31:55.575388 tst assert_extension.py:10: start nitb and bts... 16:31:55.796725 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:31:56.470442 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6154): Launched 16:31:56.800849 run osmo-nitb_10.42.42.2(pid=6155): Launched 16:31:56.984899 run osmo-nitb_10.42.42.2(pid=6155): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6155)] 16:31:57.131738 run osmo-nitb_10.42.42.2(pid=6155): stdout: | (launched: 2022-12-13_16:31:56.740038) 16:31:57.279962 run osmo-nitb_10.42.42.2(pid=6155): stderr: | (launched: 2022-12-13_16:31:56.789055) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:31:57.428321 run osmo-nitb_10.42.42.2(pid=6155): stdout: | (launched: 2022-12-13_16:31:56.740038) 16:31:57.570657 run osmo-nitb_10.42.42.2(pid=6155): stderr: | (launched: 2022-12-13_16:31:56.789055) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6155): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6155) [trial-2391↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6155)] 16:31:57.926855 tst osmo-nitb_10.42.42.2(pid=6155): stdout: | (launched: 2022-12-13_16:31:56.740038) 16:31:58.058498 tst osmo-nitb_10.42.42.2(pid=6155): stderr: | (launched: 2022-12-13_16:31:56.789055) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:31:58.214495 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6155): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6155) [trial-2391↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6155)] [trial-2391↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 16:31:58.223687 tst assert_extension.py:12: Test FAILED (3.3 sec) 16:31:58.231014 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6154): Terminating (SIGTERM) 16:31:58.443211 --- ParallelTerminationStrategy: PID 6154 died... 16:31:58.465320 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6154): Terminated: ok {rc=0} 16:31:58.554340 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 16:31:59.730284 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:59.735285 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:31:59.765749 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:31:59.793046 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 16:31:59.829982 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:31:59.859736 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:31:59.886523 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 16:32:00.416150 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2391 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 16:32:00.422883 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:00.434466 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:32:00.481156 tst assert_extension.py: using LAC 34857 16:32:00.602984 tst assert_extension.py: using RAC 177 16:32:00.724758 tst assert_extension.py: using CellId 34857 16:32:00.854156 tst assert_extension.py: using BVCI 34858 16:32:00.985991 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:00.997755 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:01.010832 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:01.022720 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:01.034629 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:01.045934 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 16:32:01.185356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:01.673233 run create_hlr_db(pid=6159): Launched 16:32:01.834548 bus /sierra_2: Setting Powered False 16:32:02.895322 run create_hlr_db(pid=6159): Terminated: ok {rc=0} 16:32:03.346445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6161): Launched 16:32:03.677166 run osmo-hlr_10.42.42.2(pid=6162): Launched 16:32:03.803097 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:04.375718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6164): Launched 16:32:04.706117 run osmo-stp_10.42.42.5(pid=6165): Launched 16:32:04.831914 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:05.426068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6167): Launched 16:32:05.757783 run osmo-msc_10.42.42.6(pid=6168): Launched 16:32:05.942470 run osmo-stp_10.42.42.5(pid=6165): ERR: Terminated: ERROR {rc=1} [trial-2391↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6165)] 16:32:06.080252 run osmo-stp_10.42.42.5(pid=6165): stdout: | (launched: 2022-12-13_16:32:04.644764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:06.218863 run osmo-stp_10.42.42.5(pid=6165): stderr: | [0;m[38;5;43m20221213163204837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163204837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163204837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163204838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163204838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163204838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163204838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:06.356066 run osmo-stp_10.42.42.5(pid=6165): stdout: | (launched: 2022-12-13_16:32:04.644764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:06.487111 run osmo-stp_10.42.42.5(pid=6165): stderr: | [0;m[38;5;43m20221213163204837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163204837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163204837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163204838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163204838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163204838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163204838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:06.643316 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6165): Process ended prematurely: osmo-stp_10.42.42.5(pid=6165) [trial-2391↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6165)] [trial-2391↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 16:32:06.652310 tst assert_extension.py:17: Test FAILED (6.2 sec) 16:32:06.680229 run osmo-hlr_10.42.42.2(pid=6162): ERR: Terminated: ERROR {rc=237} [trial-2391↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6162)] 16:32:06.731578 run osmo-hlr_10.42.42.2(pid=6162): stdout: | (launched: 2022-12-13_16:32:03.615719) 16:32:06.783740 run osmo-hlr_10.42.42.2(pid=6162): stderr: | [0;m[1;31m20221213163203815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163203815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163203815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163203815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163203815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163203815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163203828 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163203836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163203837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163203837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:06.856622 run osmo-msc_10.42.42.6(pid=6168): ERR: Terminated: ERROR {rc=2} [trial-2391↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6168)] 16:32:06.907070 run osmo-msc_10.42.42.6(pid=6168): stdout: | (launched: 2022-12-13_16:32:05.696715) 16:32:06.959311 run osmo-msc_10.42.42.6(pid=6168): stderr: | [0;m[38;5;43m20221213163206018 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163206018 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faf1cc49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163206018 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163206018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163206018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163206019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163206020 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163206021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163206021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163206021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:07.012154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6161): Terminating (SIGTERM) 16:32:07.054075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6164): Terminating (SIGTERM) 16:32:07.096680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6167): Terminating (SIGTERM) 16:32:07.139681 --- ParallelTerminationStrategy: PID 6161 died... 16:32:07.160648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6161): Terminated: ok {rc=0} 16:32:07.207773 --- ParallelTerminationStrategy: PID 6164 died... 16:32:07.227950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6164): Terminated: ok {rc=0} 16:32:07.275547 --- ParallelTerminationStrategy: PID 6167 died... 16:32:07.295355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6167): Terminated: ok {rc=0} 16:32:07.385896 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:32:08.598012 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:32:08.605373 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:32:08.635733 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:32:08.664636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:32:08.719598 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:32:08.752112 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:32:08.780842 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:32:09.327560 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:32:09.378947 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:09.390560 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:32:09.457224 tst mo_mt_call.py: using LAC 34858 16:32:09.579965 tst mo_mt_call.py: using RAC 178 16:32:09.705203 tst mo_mt_call.py: using CellId 34858 16:32:09.829105 tst mo_mt_call.py: using BVCI 34859 16:32:09.942353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:09.953978 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:09.965218 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:09.976352 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:09.987697 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:09.998942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:32:10.115556 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:32:10.238171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:10.759995 run create_hlr_db(pid=6173): Launched 16:32:10.888791 bus /sierra_2: Setting Powered False 16:32:11.951510 run create_hlr_db(pid=6173): Terminated: ok {rc=0} 16:32:12.389271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6175): Launched 16:32:12.704645 run osmo-hlr_10.42.42.2(pid=6176): Launched 16:32:12.824357 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:13.363822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6178): Launched 16:32:13.678982 run osmo-stp_10.42.42.5(pid=6179): Launched 16:32:13.798823 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:14.362258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6181): Launched 16:32:14.678690 run osmo-msc_10.42.42.6(pid=6182): Launched 16:32:14.856136 run osmo-stp_10.42.42.5(pid=6179): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6179)] 16:32:14.987677 run osmo-stp_10.42.42.5(pid=6179): stdout: | (launched: 2022-12-13_16:32:13.620697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:15.119575 run osmo-stp_10.42.42.5(pid=6179): stderr: | [0;m[38;5;43m20221213163213792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163213792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163213792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163213793 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163213793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163213793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163213793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:15.249639 run osmo-stp_10.42.42.5(pid=6179): stdout: | (launched: 2022-12-13_16:32:13.620697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:15.373516 run osmo-stp_10.42.42.5(pid=6179): stderr: | [0;m[38;5;43m20221213163213792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163213792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163213792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163213793 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163213793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163213793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163213793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:15.521416 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6179): Process ended prematurely: osmo-stp_10.42.42.5(pid=6179) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6179)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:32:15.530569 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:32:15.557578 run osmo-hlr_10.42.42.2(pid=6176): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6176)] 16:32:15.605831 run osmo-hlr_10.42.42.2(pid=6176): stdout: | (launched: 2022-12-13_16:32:12.646805) 16:32:15.655586 run osmo-hlr_10.42.42.2(pid=6176): stderr: | [0;m[1;31m20221213163212824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163212824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163212824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163212824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163212824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163212824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163212836 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163212845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163212845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163212845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:15.725328 run osmo-msc_10.42.42.6(pid=6182): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6182)] 16:32:15.773203 run osmo-msc_10.42.42.6(pid=6182): stdout: | (launched: 2022-12-13_16:32:14.620216) 16:32:15.822713 run osmo-msc_10.42.42.6(pid=6182): stderr: | [0;m[38;5;43m20221213163214891 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163214892 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffaba0e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163214892 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163214892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163214892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163214892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163214894 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163214894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163214895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163214895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:15.879260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6175): Terminating (SIGTERM) 16:32:15.932194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6178): Terminating (SIGTERM) 16:32:15.973919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6181): Terminating (SIGTERM) 16:32:16.016856 --- ParallelTerminationStrategy: PID 6175 died... 16:32:16.036832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6175): Terminated: ok {rc=0} 16:32:16.082543 --- ParallelTerminationStrategy: PID 6178 died... 16:32:16.102271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6178): Terminated: ok {rc=0} 16:32:16.147706 --- ParallelTerminationStrategy: PID 6181 died... 16:32:16.167448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6181): Terminated: ok {rc=0} 16:32:16.258619 bus /sierra_3: Setting Powered False 16:32:17.366656 bus /sierra_3: Setting Powered False 16:32:18.480807 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:32:19.632097 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:19.644904 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:32:19.714608 tst mo_mt_call_osmux.py: using LAC 34859 16:32:19.846625 tst mo_mt_call_osmux.py: using RAC 179 16:32:19.977455 tst mo_mt_call_osmux.py: using CellId 34859 16:32:20.100629 tst mo_mt_call_osmux.py: using BVCI 34860 16:32:20.215630 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:20.227285 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:20.238796 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:20.250299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:20.262015 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:32:20.273590 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:32:20.395460 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:32:20.517169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:21.001661 run create_hlr_db(pid=6184): Launched 16:32:21.129674 bus /sierra_2: Setting Powered False 16:32:22.191667 run create_hlr_db(pid=6184): Terminated: ok {rc=0} 16:32:22.648659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6186): Launched 16:32:22.985639 run osmo-hlr_10.42.42.2(pid=6187): Launched 16:32:23.115484 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:23.695562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6189): Launched 16:32:24.030603 run osmo-stp_10.42.42.5(pid=6190): Launched 16:32:24.160225 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:24.771067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6192): Launched 16:32:25.107648 run osmo-msc_10.42.42.6(pid=6193): Launched 16:32:25.295036 run osmo-stp_10.42.42.5(pid=6190): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6190)] 16:32:25.436530 run osmo-stp_10.42.42.5(pid=6190): stdout: | (launched: 2022-12-13_16:32:23.968872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:25.578382 run osmo-stp_10.42.42.5(pid=6190): stderr: | [0;m[38;5;43m20221213163224161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163224161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163224161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163224161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163224162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163224162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163224162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:25.717620 run osmo-stp_10.42.42.5(pid=6190): stdout: | (launched: 2022-12-13_16:32:23.968872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:25.850701 run osmo-stp_10.42.42.5(pid=6190): stderr: | [0;m[38;5;43m20221213163224161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163224161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163224161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163224161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163224162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163224162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163224162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:26.010137 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6190): Process ended prematurely: osmo-stp_10.42.42.5(pid=6190) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6190)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:32:26.019978 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:32:26.048402 run osmo-hlr_10.42.42.2(pid=6187): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6187)] 16:32:26.100011 run osmo-hlr_10.42.42.2(pid=6187): stdout: | (launched: 2022-12-13_16:32:22.923859) 16:32:26.152702 run osmo-hlr_10.42.42.2(pid=6187): stderr: | [0;m[1;31m20221213163223118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163223119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163223119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163223119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163223119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163223119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163223132 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163223141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163223141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163223141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:26.226302 run osmo-msc_10.42.42.6(pid=6193): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6193)] 16:32:26.277401 run osmo-msc_10.42.42.6(pid=6193): stdout: | (launched: 2022-12-13_16:32:25.045336) 16:32:26.330113 run osmo-msc_10.42.42.6(pid=6193): stderr: | [0;m[38;5;43m20221213163225368 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163225368 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4044fcac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163225368 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163225368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163225369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163225369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163225371 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163225371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163225371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163225371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:26.383274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6186): Terminating (SIGTERM) 16:32:26.425590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6189): Terminating (SIGTERM) 16:32:26.468470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6192): Terminating (SIGTERM) 16:32:26.511666 --- ParallelTerminationStrategy: PID 6186 died... 16:32:26.532259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6186): Terminated: ok {rc=0} 16:32:26.580084 --- ParallelTerminationStrategy: PID 6189 died... 16:32:26.600553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6189): Terminated: ok {rc=0} 16:32:26.647379 --- ParallelTerminationStrategy: PID 6192 died... 16:32:26.667571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6192): Terminated: ok {rc=0} 16:32:26.758511 bus /sierra_3: Setting Powered False 16:32:27.859558 bus /sierra_3: Setting Powered False 16:32:28.978611 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:32:30.230024 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:32:30.238267 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:32:30.268394 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:32:30.297249 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:32:30.352723 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:32:30.382437 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:32:30.409594 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:32:30.978939 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:32:31.038536 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:31.050993 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:32:31.119347 tst mo_mt_call.py: using LAC 34860 16:32:31.285458 tst mo_mt_call.py: using RAC 180 16:32:31.451897 tst mo_mt_call.py: using CellId 34860 16:32:31.598216 tst mo_mt_call.py: using BVCI 34861 16:32:31.758185 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:31.773438 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:31.788100 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:31.803009 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:31.818924 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:31.834041 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:32:31.988731 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:32:32.107678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:32.603088 run create_hlr_db(pid=6198): Launched 16:32:32.733522 bus /sierra_2: Setting Powered False 16:32:33.795755 run create_hlr_db(pid=6198): Terminated: ok {rc=0} 16:32:34.234446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6200): Launched 16:32:34.549161 run osmo-hlr_10.42.42.2(pid=6201): Launched 16:32:34.669486 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:35.208622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6203): Launched 16:32:35.526679 run osmo-stp_10.42.42.5(pid=6204): Launched 16:32:35.647151 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:36.218134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6206): Launched 16:32:36.535233 run osmo-msc_10.42.42.6(pid=6207): Launched 16:32:36.714240 run osmo-stp_10.42.42.5(pid=6204): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6204)] 16:32:36.846113 run osmo-stp_10.42.42.5(pid=6204): stdout: | (launched: 2022-12-13_16:32:35.468238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:36.978380 run osmo-stp_10.42.42.5(pid=6204): stderr: | [0;m[38;5;43m20221213163235639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163235639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163235639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163235640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163235640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163235640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163235640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:37.109166 run osmo-stp_10.42.42.5(pid=6204): stdout: | (launched: 2022-12-13_16:32:35.468238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:37.233677 run osmo-stp_10.42.42.5(pid=6204): stderr: | [0;m[38;5;43m20221213163235639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163235639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163235639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163235640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163235640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163235640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163235640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:37.383209 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6204): Process ended prematurely: osmo-stp_10.42.42.5(pid=6204) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6204)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:32:37.392436 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:32:37.419401 run osmo-hlr_10.42.42.2(pid=6201): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6201)] 16:32:37.467763 run osmo-hlr_10.42.42.2(pid=6201): stdout: | (launched: 2022-12-13_16:32:34.490814) 16:32:37.517932 run osmo-hlr_10.42.42.2(pid=6201): stderr: | [0;m[1;31m20221213163234665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163234665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163234666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163234666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163234666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163234666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163234695 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163234705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163234706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163234706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:37.587939 run osmo-msc_10.42.42.6(pid=6207): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6207)] 16:32:37.635770 run osmo-msc_10.42.42.6(pid=6207): stdout: | (launched: 2022-12-13_16:32:36.477067) 16:32:37.685256 run osmo-msc_10.42.42.6(pid=6207): stderr: | [0;m[38;5;43m20221213163236747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163236748 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f45bc9ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163236748 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163236748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163236748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163236748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163236750 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163236751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163236751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163236751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:37.735267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6200): Terminating (SIGTERM) 16:32:37.775083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6203): Terminating (SIGTERM) 16:32:37.814848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6206): Terminating (SIGTERM) 16:32:37.855624 --- ParallelTerminationStrategy: PID 6200 died... 16:32:37.874686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6200): Terminated: ok {rc=0} 16:32:37.919103 --- ParallelTerminationStrategy: PID 6203 died... 16:32:37.937895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6203): Terminated: ok {rc=0} 16:32:37.981736 --- ParallelTerminationStrategy: PID 6206 died... 16:32:38.000465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6206): Terminated: ok {rc=0} 16:32:38.086177 bus /sierra_3: Setting Powered False 16:32:39.187600 bus /sierra_3: Setting Powered False 16:32:40.302317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:32:41.455903 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:41.468880 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:32:41.542753 tst mo_mt_call_osmux.py: using LAC 34861 16:32:41.674927 tst mo_mt_call_osmux.py: using RAC 181 16:32:41.807018 tst mo_mt_call_osmux.py: using CellId 34861 16:32:41.936798 tst mo_mt_call_osmux.py: using BVCI 34862 16:32:42.058893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:42.070991 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:42.082824 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:42.094764 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:42.107053 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:32:42.119160 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:32:42.241885 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:32:42.363445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:42.852547 run create_hlr_db(pid=6209): Launched 16:32:42.981759 bus /sierra_2: Setting Powered False 16:32:44.043808 run create_hlr_db(pid=6209): Terminated: ok {rc=0} 16:32:44.503756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6211): Launched 16:32:44.841908 run osmo-hlr_10.42.42.2(pid=6212): Launched 16:32:44.971002 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:45.554008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6214): Launched 16:32:45.893733 run osmo-stp_10.42.42.5(pid=6215): Launched 16:32:46.157559 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:46.810902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6217): Launched 16:32:47.149492 run osmo-msc_10.42.42.6(pid=6218): Launched 16:32:47.416654 run osmo-stp_10.42.42.5(pid=6215): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6215)] 16:32:47.556919 run osmo-stp_10.42.42.5(pid=6215): stdout: | (launched: 2022-12-13_16:32:45.832531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:47.699646 run osmo-stp_10.42.42.5(pid=6215): stderr: | [0;m[38;5;43m20221213163246062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163246062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163246062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163246062 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163246063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163246063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163246063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:47.840733 run osmo-stp_10.42.42.5(pid=6215): stdout: | (launched: 2022-12-13_16:32:45.832531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:47.974567 run osmo-stp_10.42.42.5(pid=6215): stderr: | [0;m[38;5;43m20221213163246062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163246062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163246062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163246062 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163246063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163246063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163246063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:48.135071 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6215): Process ended prematurely: osmo-stp_10.42.42.5(pid=6215) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6215)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:32:48.144759 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 16:32:48.173444 run osmo-hlr_10.42.42.2(pid=6212): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6212)] 16:32:48.225635 run osmo-hlr_10.42.42.2(pid=6212): stdout: | (launched: 2022-12-13_16:32:44.779862) 16:32:48.278896 run osmo-hlr_10.42.42.2(pid=6212): stderr: | [0;m[1;31m20221213163244977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163244977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163244977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163244978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163244978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163244978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163244990 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163245001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163245001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163245001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:48.353152 run osmo-msc_10.42.42.6(pid=6218): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6218)] 16:32:48.404119 run osmo-msc_10.42.42.6(pid=6218): stdout: | (launched: 2022-12-13_16:32:47.089204) 16:32:48.457322 run osmo-msc_10.42.42.6(pid=6218): stderr: | [0;m[38;5;43m20221213163247472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163247473 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fec2c8d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163247473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163247473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163247473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163247473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163247475 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163247475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163247475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163247476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:48.510859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6211): Terminating (SIGTERM) 16:32:48.553365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6214): Terminating (SIGTERM) 16:32:48.596410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6217): Terminating (SIGTERM) 16:32:48.639879 --- ParallelTerminationStrategy: PID 6211 died... 16:32:48.660855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6211): Terminated: ok {rc=0} 16:32:48.708415 --- ParallelTerminationStrategy: PID 6214 died... 16:32:48.728822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6214): Terminated: ok {rc=0} 16:32:48.776380 --- ParallelTerminationStrategy: PID 6217 died... 16:32:48.796830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6217): Terminated: ok {rc=0} 16:32:48.887176 bus /sierra_3: Setting Powered False 16:32:49.987961 bus /sierra_3: Setting Powered False 16:32:51.105969 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:32:52.356417 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:32:52.362952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:32:52.391997 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:32:52.418994 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:32:52.476011 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:32:52.506080 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:32:52.532871 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:32:53.081876 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:32:53.132142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:32:53.144083 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:32:53.209318 tst mo_mt_call.py: using LAC 34862 16:32:53.331007 tst mo_mt_call.py: using RAC 182 16:32:53.453618 tst mo_mt_call.py: using CellId 34862 16:32:53.577384 tst mo_mt_call.py: using BVCI 34863 16:32:53.692312 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:32:53.703730 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:32:53.715136 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:32:53.726579 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:32:53.738114 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:32:53.749514 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:32:53.873018 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:32:53.997492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:54.521359 run create_hlr_db(pid=6223): Launched 16:32:54.653958 bus /sierra_2: Setting Powered False 16:32:55.720265 run create_hlr_db(pid=6223): Terminated: ok {rc=0} 16:32:56.188892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6225): Launched 16:32:56.528860 run osmo-hlr_10.42.42.2(pid=6226): Launched 16:32:56.659609 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:57.244562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6228): Launched 16:32:57.584392 run osmo-stp_10.42.42.5(pid=6229): Launched 16:32:57.715475 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:58.328146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6231): Launched 16:32:58.668310 run osmo-msc_10.42.42.6(pid=6232): Launched 16:32:58.859675 run osmo-stp_10.42.42.5(pid=6229): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6229)] 16:32:59.001181 run osmo-stp_10.42.42.5(pid=6229): stdout: | (launched: 2022-12-13_16:32:57.522362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:59.143871 run osmo-stp_10.42.42.5(pid=6229): stderr: | [0;m[38;5;43m20221213163257714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163257714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163257714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163257714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163257715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163257715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163257715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:59.284028 run osmo-stp_10.42.42.5(pid=6229): stdout: | (launched: 2022-12-13_16:32:57.522362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:59.418285 run osmo-stp_10.42.42.5(pid=6229): stderr: | [0;m[38;5;43m20221213163257714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163257714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163257714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163257714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163257715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163257715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163257715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:59.578465 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6229): Process ended prematurely: osmo-stp_10.42.42.5(pid=6229) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6229)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:32:59.588276 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:32:59.617191 run osmo-hlr_10.42.42.2(pid=6226): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6226)] 16:32:59.669304 run osmo-hlr_10.42.42.2(pid=6226): stdout: | (launched: 2022-12-13_16:32:56.466968) 16:32:59.722346 run osmo-hlr_10.42.42.2(pid=6226): stderr: | [0;m[1;31m20221213163256663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163256663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163256663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163256663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163256664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163256664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163256679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163256689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163256689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163256690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:59.797039 run osmo-msc_10.42.42.6(pid=6232): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6232)] 16:32:59.848456 run osmo-msc_10.42.42.6(pid=6232): stdout: | (launched: 2022-12-13_16:32:58.605852) 16:32:59.901576 run osmo-msc_10.42.42.6(pid=6232): stderr: | [0;m[38;5;43m20221213163258928 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163258929 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe02585ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163258929 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163258929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163258929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163258929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163258931 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163258931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163258933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163258933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:59.954930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6225): Terminating (SIGTERM) 16:32:59.997750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6228): Terminating (SIGTERM) 16:33:00.040683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6231): Terminating (SIGTERM) 16:33:00.083966 --- ParallelTerminationStrategy: PID 6225 died... 16:33:00.104888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6225): Terminated: ok {rc=0} 16:33:00.152494 --- ParallelTerminationStrategy: PID 6228 died... 16:33:00.172877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6228): Terminated: ok {rc=0} 16:33:00.220201 --- ParallelTerminationStrategy: PID 6231 died... 16:33:00.240691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6231): Terminated: ok {rc=0} 16:33:00.331087 bus /sierra_3: Setting Powered False 16:33:01.430304 bus /sierra_3: Setting Powered False 16:33:02.550893 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:33:03.701925 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:33:03.714368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:33:03.782741 tst mo_mt_call_osmux.py: using LAC 34863 16:33:03.909211 tst mo_mt_call_osmux.py: using RAC 183 16:33:04.033738 tst mo_mt_call_osmux.py: using CellId 34863 16:33:04.159357 tst mo_mt_call_osmux.py: using BVCI 34864 16:33:04.275140 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:33:04.286599 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:33:04.298421 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:33:04.309836 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:33:04.321924 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:33:04.334573 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:33:04.453763 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:33:04.573082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:05.061309 run create_hlr_db(pid=6235): Launched 16:33:05.188752 bus /sierra_2: Setting Powered False 16:33:06.251291 run create_hlr_db(pid=6235): Terminated: ok {rc=0} 16:33:06.689140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6237): Launched 16:33:07.005698 run osmo-hlr_10.42.42.2(pid=6238): Launched 16:33:07.127002 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:07.666673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6240): Launched 16:33:07.982182 run osmo-stp_10.42.42.5(pid=6241): Launched 16:33:08.103496 run osmo-msc_10.42.42.6: Starting osmo-msc 16:33:08.672238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6243): Launched 16:33:08.988647 run osmo-msc_10.42.42.6(pid=6244): Launched 16:33:09.166275 run osmo-stp_10.42.42.5(pid=6241): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6241)] 16:33:09.297842 run osmo-stp_10.42.42.5(pid=6241): stdout: | (launched: 2022-12-13_16:33:07.923745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:09.429082 run osmo-stp_10.42.42.5(pid=6241): stderr: | [0;m[38;5;43m20221213163308095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163308095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163308096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163308096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163308097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163308097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163308097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:09.558599 run osmo-stp_10.42.42.5(pid=6241): stdout: | (launched: 2022-12-13_16:33:07.923745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:09.682300 run osmo-stp_10.42.42.5(pid=6241): stderr: | [0;m[38;5;43m20221213163308095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163308095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163308096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163308096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163308097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163308097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163308097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:09.830923 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6241): Process ended prematurely: osmo-stp_10.42.42.5(pid=6241) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6241)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:33:09.840034 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:33:09.867035 run osmo-hlr_10.42.42.2(pid=6238): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6238)] 16:33:09.915649 run osmo-hlr_10.42.42.2(pid=6238): stdout: | (launched: 2022-12-13_16:33:06.947344) 16:33:09.965953 run osmo-hlr_10.42.42.2(pid=6238): stderr: | [0;m[1;31m20221213163307123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163307123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163307123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163307123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163307123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163307123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163307136 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163307144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163307144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163307144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:10.035911 run osmo-msc_10.42.42.6(pid=6244): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6244)] 16:33:10.083887 run osmo-msc_10.42.42.6(pid=6244): stdout: | (launched: 2022-12-13_16:33:08.930240) 16:33:10.133715 run osmo-msc_10.42.42.6(pid=6244): stderr: | [0;m[38;5;43m20221213163309201 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163309201 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1fae5cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163309201 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163309201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163309201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163309201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163309203 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163309203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163309204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163309204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:33:10.184007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6237): Terminating (SIGTERM) 16:33:10.224271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6240): Terminating (SIGTERM) 16:33:10.264726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6243): Terminating (SIGTERM) 16:33:10.305083 --- ParallelTerminationStrategy: PID 6237 died... 16:33:10.324421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6237): Terminated: ok {rc=0} 16:33:10.368502 --- ParallelTerminationStrategy: PID 6240 died... 16:33:10.387459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6240): Terminated: ok {rc=0} 16:33:10.431793 --- ParallelTerminationStrategy: PID 6243 died... 16:33:10.450734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6243): Terminated: ok {rc=0} 16:33:10.537116 bus /sierra_3: Setting Powered False 16:33:11.638984 bus /sierra_3: Setting Powered False 16:33:12.758319 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:33:14.006184 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:33:14.012698 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:33:14.041791 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:33:14.068784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:33:14.123404 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:33:14.154981 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:33:14.183248 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:33:14.734218 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:33:14.789116 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:14.801317 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:33:14.869882 tst mo_mt_call.py: using LAC 34864 16:33:15.002907 tst mo_mt_call.py: using RAC 184 16:33:15.135254 tst mo_mt_call.py: using CellId 34864 16:33:15.267152 tst mo_mt_call.py: using BVCI 34865 16:33:15.391765 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:15.404220 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:15.416236 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:15.428281 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:15.440918 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:15.453597 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:33:15.571821 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:33:15.690354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:16.244299 run create_hlr_db(pid=6250): Launched 16:33:16.433127 bus /sierra_2: Setting Powered False 16:33:17.499527 run create_hlr_db(pid=6250): Terminated: ok {rc=0} 16:33:17.950180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6252): Launched 16:33:18.268101 run osmo-hlr_10.42.42.2(pid=6253): Launched 16:33:18.390805 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:18.945901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6255): Launched 16:33:19.258581 run osmo-stp_10.42.42.5(pid=6256): Launched 16:33:19.379984 run osmo-msc_10.42.42.6: Starting osmo-msc 16:33:19.945430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6258): Launched 16:33:20.261814 run osmo-msc_10.42.42.6(pid=6259): Launched 16:33:20.440089 run osmo-stp_10.42.42.5(pid=6256): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6256)] 16:33:20.572874 run osmo-stp_10.42.42.5(pid=6256): stdout: | (launched: 2022-12-13_16:33:19.200788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:20.704746 run osmo-stp_10.42.42.5(pid=6256): stderr: | [0;m[38;5;43m20221213163319372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163319372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163319372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163319373 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163319373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163319373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163319374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:20.834675 run osmo-stp_10.42.42.5(pid=6256): stdout: | (launched: 2022-12-13_16:33:19.200788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:20.959210 run osmo-stp_10.42.42.5(pid=6256): stderr: | [0;m[38;5;43m20221213163319372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163319372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163319372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163319373 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163319373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163319373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163319374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:21.107926 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6256): Process ended prematurely: osmo-stp_10.42.42.5(pid=6256) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6256)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:33:21.117216 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:33:21.144021 run osmo-hlr_10.42.42.2(pid=6253): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6253)] 16:33:21.191748 run osmo-hlr_10.42.42.2(pid=6253): stdout: | (launched: 2022-12-13_16:33:18.209725) 16:33:21.241057 run osmo-hlr_10.42.42.2(pid=6253): stderr: | [0;m[1;31m20221213163318388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163318388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163318388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163318388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163318388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163318388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163318400 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163318408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163318409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163318409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:21.310046 run osmo-msc_10.42.42.6(pid=6259): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6259)] 16:33:21.357581 run osmo-msc_10.42.42.6(pid=6259): stdout: | (launched: 2022-12-13_16:33:20.203398) 16:33:21.406720 run osmo-msc_10.42.42.6(pid=6259): stderr: | [0;m[38;5;43m20221213163320478 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163320478 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04f4accc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163320478 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163320478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163320478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163320479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163320480 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163320481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163320481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163320481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:33:21.455954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6252): Terminating (SIGTERM) 16:33:21.495530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6255): Terminating (SIGTERM) 16:33:21.535200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6258): Terminating (SIGTERM) 16:33:21.575733 --- ParallelTerminationStrategy: PID 6252 died... 16:33:21.595034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6252): Terminated: ok {rc=0} 16:33:21.638915 --- ParallelTerminationStrategy: PID 6255 died... 16:33:21.657707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6255): Terminated: ok {rc=0} 16:33:21.701433 --- ParallelTerminationStrategy: PID 6258 died... 16:33:21.720300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6258): Terminated: ok {rc=0} 16:33:21.806674 bus /sierra_3: Setting Powered False 16:33:22.906995 bus /sierra_3: Setting Powered False 16:33:24.024768 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:33:25.173988 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:25.186414 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:33:25.253396 tst mo_mt_call_osmux.py: using LAC 34865 16:33:25.376833 tst mo_mt_call_osmux.py: using RAC 185 16:33:25.500404 tst mo_mt_call_osmux.py: using CellId 34865 16:33:25.624746 tst mo_mt_call_osmux.py: using BVCI 34866 16:33:25.739907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:25.751389 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:25.762661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:25.773975 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:25.785317 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:33:25.796511 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:33:25.919766 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:33:26.041295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:26.529705 run create_hlr_db(pid=6261): Launched 16:33:26.659112 bus /sierra_2: Setting Powered False 16:33:27.724923 run create_hlr_db(pid=6261): Terminated: ok {rc=0} 16:33:28.191830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6263): Launched 16:33:28.532186 run osmo-hlr_10.42.42.2(pid=6264): Launched 16:33:28.663127 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:29.244310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6266): Launched 16:33:29.583320 run osmo-stp_10.42.42.5(pid=6267): Launched 16:33:29.713790 run osmo-msc_10.42.42.6: Starting osmo-msc 16:33:30.321746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6269): Launched 16:33:30.660302 run osmo-msc_10.42.42.6(pid=6270): Launched 16:33:30.904457 run osmo-stp_10.42.42.5(pid=6267): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6267)] 16:33:31.125489 run osmo-stp_10.42.42.5(pid=6267): stdout: | (launched: 2022-12-13_16:33:29.521290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:31.405144 run osmo-stp_10.42.42.5(pid=6267): stderr: | [0;m[38;5;43m20221213163329712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163329712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163329713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163329713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163329714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163329714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163329714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:31.592307 run osmo-stp_10.42.42.5(pid=6267): stdout: | (launched: 2022-12-13_16:33:29.521290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:31.743250 run osmo-stp_10.42.42.5(pid=6267): stderr: | [0;m[38;5;43m20221213163329712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163329712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163329713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163329713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163329714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163329714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163329714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:31.905786 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6267): Process ended prematurely: osmo-stp_10.42.42.5(pid=6267) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6267)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:33:31.922018 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 16:33:31.956614 run osmo-hlr_10.42.42.2(pid=6264): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6264)] 16:33:32.008761 run osmo-hlr_10.42.42.2(pid=6264): stdout: | (launched: 2022-12-13_16:33:28.470247) 16:33:32.061611 run osmo-hlr_10.42.42.2(pid=6264): stderr: | [0;m[1;31m20221213163328668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163328668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163328668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163328668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163328668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163328668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163328680 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163328688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163328688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163328688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:32.134547 run osmo-msc_10.42.42.6(pid=6270): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6270)] 16:33:32.185916 run osmo-msc_10.42.42.6(pid=6270): stdout: | (launched: 2022-12-13_16:33:30.598321) 16:33:32.238819 run osmo-msc_10.42.42.6(pid=6270): stderr: | [0;m[38;5;43m20221213163330939 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163330939 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fabb81a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163330939 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163330939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163330940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163330940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163330945 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163330946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163330946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163330946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:33:32.292544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6263): Terminating (SIGTERM) 16:33:32.334621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6266): Terminating (SIGTERM) 16:33:32.380422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6269): Terminating (SIGTERM) 16:33:32.423727 --- ParallelTerminationStrategy: PID 6263 died... 16:33:32.444618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6263): Terminated: ok {rc=0} 16:33:32.493484 --- ParallelTerminationStrategy: PID 6266 died... 16:33:32.512669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6266): Terminated: ok {rc=0} 16:33:32.557797 --- ParallelTerminationStrategy: PID 6269 died... 16:33:32.577344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6269): Terminated: ok {rc=0} 16:33:32.664838 bus /sierra_3: Setting Powered False 16:33:33.765411 bus /sierra_3: Setting Powered False 16:33:34.882071 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:33:36.136402 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:33:36.143835 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:33:36.174235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:33:36.203581 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:33:36.257340 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:33:36.287606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:33:36.316481 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:33:36.874646 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:33:36.929492 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:36.941544 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:33:37.010326 tst mo_mt_call.py: using LAC 34866 16:33:37.143517 tst mo_mt_call.py: using RAC 186 16:33:37.276651 tst mo_mt_call.py: using CellId 34866 16:33:37.408896 tst mo_mt_call.py: using BVCI 34867 16:33:37.532940 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:37.545168 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:37.557244 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:37.569810 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:37.582320 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:37.594677 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:33:37.719726 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:33:37.843064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:38.365196 run create_hlr_db(pid=6276): Launched 16:33:38.495652 bus /sierra_2: Setting Powered False 16:33:39.561435 run create_hlr_db(pid=6276): Terminated: ok {rc=0} 16:33:40.010899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6278): Launched 16:33:40.326054 run osmo-hlr_10.42.42.2(pid=6279): Launched 16:33:40.446728 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:40.991244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6281): Launched 16:33:41.309583 run osmo-stp_10.42.42.5(pid=6282): Launched 16:33:41.432841 run osmo-msc_10.42.42.6: Starting osmo-msc 16:33:42.001769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6284): Launched 16:33:42.317093 run osmo-msc_10.42.42.6(pid=6285): Launched 16:33:42.494531 run osmo-stp_10.42.42.5(pid=6282): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6282)] 16:33:42.626129 run osmo-stp_10.42.42.5(pid=6282): stdout: | (launched: 2022-12-13_16:33:41.251018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:42.758459 run osmo-stp_10.42.42.5(pid=6282): stderr: | [0;m[38;5;43m20221213163341424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163341424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163341425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163341425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163341426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163341426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163341426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:42.888715 run osmo-stp_10.42.42.5(pid=6282): stdout: | (launched: 2022-12-13_16:33:41.251018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:43.013676 run osmo-stp_10.42.42.5(pid=6282): stderr: | [0;m[38;5;43m20221213163341424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163341424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163341425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163341425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163341426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163341426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163341426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:43.163608 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6282): Process ended prematurely: osmo-stp_10.42.42.5(pid=6282) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6282)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:33:43.172834 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:33:43.199788 run osmo-hlr_10.42.42.2(pid=6279): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6279)] 16:33:43.248753 run osmo-hlr_10.42.42.2(pid=6279): stdout: | (launched: 2022-12-13_16:33:40.267758) 16:33:43.298727 run osmo-hlr_10.42.42.2(pid=6279): stderr: | [0;m[1;31m20221213163340443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163340443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163340443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163340443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163340443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163340443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163340455 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163340464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163340464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163340464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:43.368628 run osmo-msc_10.42.42.6(pid=6285): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6285)] 16:33:43.416490 run osmo-msc_10.42.42.6(pid=6285): stdout: | (launched: 2022-12-13_16:33:42.258794) 16:33:43.466181 run osmo-msc_10.42.42.6(pid=6285): stderr: | [0;m[38;5;43m20221213163342529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163342530 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb0a1bf7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163342530 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163342530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163342530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163342530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163342532 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163342532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163342532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163342532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:33:43.515982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6278): Terminating (SIGTERM) 16:33:43.556116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6281): Terminating (SIGTERM) 16:33:43.596328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6284): Terminating (SIGTERM) 16:33:43.636858 --- ParallelTerminationStrategy: PID 6278 died... 16:33:43.656137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6278): Terminated: ok {rc=0} 16:33:43.700667 --- ParallelTerminationStrategy: PID 6281 died... 16:33:43.719939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6281): Terminated: ok {rc=0} 16:33:43.764667 --- ParallelTerminationStrategy: PID 6284 died... 16:33:43.783601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6284): Terminated: ok {rc=0} 16:33:43.868372 bus /sierra_3: Setting Powered False 16:33:44.966050 bus /sierra_3: Setting Powered False 16:33:46.092941 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:33:47.267698 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:47.280103 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:33:47.347403 tst mo_mt_call_osmux.py: using LAC 34867 16:33:47.469932 tst mo_mt_call_osmux.py: using RAC 187 16:33:47.594426 tst mo_mt_call_osmux.py: using CellId 34867 16:33:47.719596 tst mo_mt_call_osmux.py: using BVCI 34868 16:33:47.833949 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:47.845522 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:47.856768 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:47.868035 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:47.879412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:33:47.890659 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:33:48.012658 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:33:48.132824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:48.620575 run create_hlr_db(pid=6287): Launched 16:33:48.749911 bus /sierra_2: Setting Powered False 16:33:49.812173 run create_hlr_db(pid=6287): Terminated: ok {rc=0} 16:33:50.271920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6289): Launched 16:33:50.611589 run osmo-hlr_10.42.42.2(pid=6290): Launched 16:33:50.742329 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:51.324392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6292): Launched 16:33:51.663916 run osmo-stp_10.42.42.5(pid=6293): Launched 16:33:51.794976 run osmo-msc_10.42.42.6: Starting osmo-msc 16:33:52.403284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6295): Launched 16:33:52.741271 run osmo-msc_10.42.42.6(pid=6296): Launched 16:33:52.929595 run osmo-stp_10.42.42.5(pid=6293): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6293)] 16:33:53.072027 run osmo-stp_10.42.42.5(pid=6293): stdout: | (launched: 2022-12-13_16:33:51.602020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:53.215522 run osmo-stp_10.42.42.5(pid=6293): stderr: | [0;m[38;5;43m20221213163351794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163351794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163351794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163351795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163351795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163351795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163351795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:53.356672 run osmo-stp_10.42.42.5(pid=6293): stdout: | (launched: 2022-12-13_16:33:51.602020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:53.490477 run osmo-stp_10.42.42.5(pid=6293): stderr: | [0;m[38;5;43m20221213163351794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163351794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163351794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163351795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163351795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163351795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163351795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:53.650916 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6293): Process ended prematurely: osmo-stp_10.42.42.5(pid=6293) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6293)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:33:53.660757 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:33:53.689309 run osmo-hlr_10.42.42.2(pid=6290): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6290)] 16:33:53.741528 run osmo-hlr_10.42.42.2(pid=6290): stdout: | (launched: 2022-12-13_16:33:50.549722) 16:33:53.794611 run osmo-hlr_10.42.42.2(pid=6290): stderr: | [0;m[1;31m20221213163350747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163350747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163350747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163350747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163350747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163350747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163350759 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163350767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163350768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163350768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:53.868742 run osmo-msc_10.42.42.6(pid=6296): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6296)] 16:33:53.920057 run osmo-msc_10.42.42.6(pid=6296): stdout: | (launched: 2022-12-13_16:33:52.679041) 16:33:53.973112 run osmo-msc_10.42.42.6(pid=6296): stderr: | [0;m[38;5;43m20221213163352999 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163352999 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba8f5b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163352999 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163352999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163353000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163353000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163353002 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163353002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163353002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163353002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:33:54.026493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6289): Terminating (SIGTERM) 16:33:54.068827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6292): Terminating (SIGTERM) 16:33:54.111844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6295): Terminating (SIGTERM) 16:33:54.155292 --- ParallelTerminationStrategy: PID 6289 died... 16:33:54.176273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6289): Terminated: ok {rc=0} 16:33:54.223526 --- ParallelTerminationStrategy: PID 6292 died... 16:33:54.244539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6292): Terminated: ok {rc=0} 16:33:54.292083 --- ParallelTerminationStrategy: PID 6295 died... 16:33:54.313103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6295): Terminated: ok {rc=0} 16:33:54.403417 bus /sierra_3: Setting Powered False 16:33:55.503173 bus /sierra_3: Setting Powered False 16:33:56.622085 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:33:57.876690 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:33:57.884253 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:33:57.915578 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:33:57.943588 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:33:57.997712 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:33:58.028384 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:33:58.057034 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:33:58.607915 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:33:58.657943 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:33:58.669511 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:33:58.736515 tst mo_mt_call.py: using LAC 34868 16:33:58.861091 tst mo_mt_call.py: using RAC 188 16:33:58.986858 tst mo_mt_call.py: using CellId 34868 16:33:59.111705 tst mo_mt_call.py: using BVCI 34869 16:33:59.227542 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:33:59.239082 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:33:59.250724 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:33:59.262286 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:33:59.273827 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:33:59.285136 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:33:59.407618 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:33:59.529516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:00.052019 run create_hlr_db(pid=6301): Launched 16:34:00.183724 bus /sierra_2: Setting Powered False 16:34:01.268447 run create_hlr_db(pid=6301): Terminated: ok {rc=0} 16:34:01.740502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6303): Launched 16:34:02.074439 run osmo-hlr_10.42.42.2(pid=6304): Launched 16:34:02.259343 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:02.843746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6306): Launched 16:34:03.184188 run osmo-stp_10.42.42.5(pid=6307): Launched 16:34:03.315208 run osmo-msc_10.42.42.6: Starting osmo-msc 16:34:03.926648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6309): Launched 16:34:04.267533 run osmo-msc_10.42.42.6(pid=6310): Launched 16:34:04.459335 run osmo-stp_10.42.42.5(pid=6307): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6307)] 16:34:04.601625 run osmo-stp_10.42.42.5(pid=6307): stdout: | (launched: 2022-12-13_16:34:03.121962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:04.744860 run osmo-stp_10.42.42.5(pid=6307): stderr: | [0;m[38;5;43m20221213163403314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163403314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163403314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163403315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163403315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163403315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163403315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:04.884813 run osmo-stp_10.42.42.5(pid=6307): stdout: | (launched: 2022-12-13_16:34:03.121962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:05.018497 run osmo-stp_10.42.42.5(pid=6307): stderr: | [0;m[38;5;43m20221213163403314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163403314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163403314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163403315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163403315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163403315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163403315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:05.179500 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6307): Process ended prematurely: osmo-stp_10.42.42.5(pid=6307) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6307)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:34:05.189432 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 16:34:05.218041 run osmo-hlr_10.42.42.2(pid=6304): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6304)] 16:34:05.269776 run osmo-hlr_10.42.42.2(pid=6304): stdout: | (launched: 2022-12-13_16:34:02.014249) 16:34:05.322791 run osmo-hlr_10.42.42.2(pid=6304): stderr: | [0;m[1;31m20221213163402278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163402278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163402278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163402278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163402278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163402278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163402291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163402301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163402301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163402301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:05.397161 run osmo-msc_10.42.42.6(pid=6310): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6310)] 16:34:05.448100 run osmo-msc_10.42.42.6(pid=6310): stdout: | (launched: 2022-12-13_16:34:04.205192) 16:34:05.500796 run osmo-msc_10.42.42.6(pid=6310): stderr: | [0;m[38;5;43m20221213163404527 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163404527 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f59dd5edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163404527 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163404527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163404527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163404527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163404529 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163404530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163404530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163404530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:34:05.553885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6303): Terminating (SIGTERM) 16:34:05.596182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6306): Terminating (SIGTERM) 16:34:05.638896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6309): Terminating (SIGTERM) 16:34:05.681950 --- ParallelTerminationStrategy: PID 6303 died... 16:34:05.702834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6303): Terminated: ok {rc=0} 16:34:05.750167 --- ParallelTerminationStrategy: PID 6306 died... 16:34:05.770930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6306): Terminated: ok {rc=0} 16:34:05.818115 --- ParallelTerminationStrategy: PID 6309 died... 16:34:05.838444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6309): Terminated: ok {rc=0} 16:34:05.928053 bus /sierra_3: Setting Powered False 16:34:07.030550 bus /sierra_3: Setting Powered False 16:34:08.147224 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:34:09.299104 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:34:09.312044 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:34:09.383704 tst mo_mt_call_osmux.py: using LAC 34869 16:34:09.517284 tst mo_mt_call_osmux.py: using RAC 189 16:34:09.648345 tst mo_mt_call_osmux.py: using CellId 34869 16:34:09.780248 tst mo_mt_call_osmux.py: using BVCI 34870 16:34:09.903178 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:34:09.915238 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:34:09.927088 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:34:09.939013 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:34:09.951346 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:34:09.963499 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:34:10.085474 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:34:10.207917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:10.730553 run create_hlr_db(pid=6312): Launched 16:34:10.858016 bus /sierra_2: Setting Powered False 16:34:11.924424 run create_hlr_db(pid=6312): Terminated: ok {rc=0} 16:34:12.371749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6314): Launched 16:34:12.689937 run osmo-hlr_10.42.42.2(pid=6315): Launched 16:34:12.812274 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:13.371374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6317): Launched 16:34:13.687915 run osmo-stp_10.42.42.5(pid=6318): Launched 16:34:13.808605 run osmo-msc_10.42.42.6: Starting osmo-msc 16:34:14.375709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6320): Launched 16:34:14.692428 run osmo-msc_10.42.42.6(pid=6321): Launched 16:34:14.869585 run osmo-stp_10.42.42.5(pid=6318): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6318)] 16:34:15.001118 run osmo-stp_10.42.42.5(pid=6318): stdout: | (launched: 2022-12-13_16:34:13.629534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:15.132434 run osmo-stp_10.42.42.5(pid=6318): stderr: | [0;m[38;5;43m20221213163413802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163413802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163413803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163413803 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163413803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163413804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163413804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:15.262514 run osmo-stp_10.42.42.5(pid=6318): stdout: | (launched: 2022-12-13_16:34:13.629534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:15.387324 run osmo-stp_10.42.42.5(pid=6318): stderr: | [0;m[38;5;43m20221213163413802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163413802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163413803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163413803 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163413803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163413804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163413804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:15.536351 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6318): Process ended prematurely: osmo-stp_10.42.42.5(pid=6318) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6318)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:34:15.545918 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:34:15.572815 run osmo-hlr_10.42.42.2(pid=6315): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6315)] 16:34:15.620764 run osmo-hlr_10.42.42.2(pid=6315): stdout: | (launched: 2022-12-13_16:34:12.631556) 16:34:15.670617 run osmo-hlr_10.42.42.2(pid=6315): stderr: | [0;m[1;31m20221213163412809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163412809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163412809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163412809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163412809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163412809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163412822 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163412830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163412830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163412830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:15.740513 run osmo-msc_10.42.42.6(pid=6321): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6321)] 16:34:15.788559 run osmo-msc_10.42.42.6(pid=6321): stdout: | (launched: 2022-12-13_16:34:14.634089) 16:34:15.838573 run osmo-msc_10.42.42.6(pid=6321): stderr: | [0;m[38;5;43m20221213163414907 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163414907 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f44f2025c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163414907 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163414907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163414908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163414908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163414909 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163414910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163414910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163414910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:34:15.895273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6314): Terminating (SIGTERM) 16:34:15.936091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6317): Terminating (SIGTERM) 16:34:15.976722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6320): Terminating (SIGTERM) 16:34:16.017703 --- ParallelTerminationStrategy: PID 6314 died... 16:34:16.036909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6314): Terminated: ok {rc=0} 16:34:16.082159 --- ParallelTerminationStrategy: PID 6317 died... 16:34:16.101752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6317): Terminated: ok {rc=0} 16:34:16.146668 --- ParallelTerminationStrategy: PID 6320 died... 16:34:16.166402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6320): Terminated: ok {rc=0} 16:34:16.252855 bus /sierra_3: Setting Powered False 16:34:17.349353 bus /sierra_3: Setting Powered False 16:34:18.465784 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:34:19.725579 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:34:19.732119 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:34:19.762574 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:34:19.792520 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:34:19.846505 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:34:19.878083 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:34:19.905889 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:34:20.455336 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:34:20.509281 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:20.521094 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:34:20.593240 tst mo_mt_call.py: using LAC 34870 16:34:20.724623 tst mo_mt_call.py: using RAC 190 16:34:20.854433 tst mo_mt_call.py: using CellId 34870 16:34:20.984263 tst mo_mt_call.py: using BVCI 34871 16:34:21.106936 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:21.118641 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:21.130204 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:21.141842 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:21.153817 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:21.165631 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:34:21.288754 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:34:21.411979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:21.932916 run create_hlr_db(pid=6328): Launched 16:34:22.062535 bus /sierra_2: Setting Powered False 16:34:23.128459 run create_hlr_db(pid=6328): Terminated: ok {rc=0} 16:34:23.597397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6330): Launched 16:34:23.937248 run osmo-hlr_10.42.42.2(pid=6331): Launched 16:34:24.067473 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:24.649322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6333): Launched 16:34:24.987035 run osmo-stp_10.42.42.5(pid=6334): Launched 16:34:25.118306 run osmo-msc_10.42.42.6: Starting osmo-msc 16:34:25.726815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6336): Launched 16:34:26.066257 run osmo-msc_10.42.42.6(pid=6337): Launched 16:34:26.255381 run osmo-stp_10.42.42.5(pid=6334): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6334)] 16:34:26.397437 run osmo-stp_10.42.42.5(pid=6334): stdout: | (launched: 2022-12-13_16:34:24.925179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:26.540017 run osmo-stp_10.42.42.5(pid=6334): stderr: | [0;m[38;5;43m20221213163425114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163425114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163425114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163425115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163425115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163425115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163425115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:26.679906 run osmo-stp_10.42.42.5(pid=6334): stdout: | (launched: 2022-12-13_16:34:24.925179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:26.814185 run osmo-stp_10.42.42.5(pid=6334): stderr: | [0;m[38;5;43m20221213163425114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163425114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163425114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163425115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163425115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163425115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163425115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:26.974048 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6334): Process ended prematurely: osmo-stp_10.42.42.5(pid=6334) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6334)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:34:26.983983 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:34:27.012646 run osmo-hlr_10.42.42.2(pid=6331): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6331)] 16:34:27.064426 run osmo-hlr_10.42.42.2(pid=6331): stdout: | (launched: 2022-12-13_16:34:23.875369) 16:34:27.117353 run osmo-hlr_10.42.42.2(pid=6331): stderr: | [0;m[1;31m20221213163424072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163424072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163424073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163424073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163424073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163424073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163424085 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163424093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163424093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163424093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:27.191022 run osmo-msc_10.42.42.6(pid=6337): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6337)] 16:34:27.242117 run osmo-msc_10.42.42.6(pid=6337): stdout: | (launched: 2022-12-13_16:34:26.003902) 16:34:27.294870 run osmo-msc_10.42.42.6(pid=6337): stderr: | [0;m[38;5;43m20221213163426325 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163426326 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b8e5bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163426326 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163426326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163426326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163426326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163426328 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163426328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163426328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163426328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:34:27.348473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6330): Terminating (SIGTERM) 16:34:27.390933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6333): Terminating (SIGTERM) 16:34:27.433311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6336): Terminating (SIGTERM) 16:34:27.476193 --- ParallelTerminationStrategy: PID 6330 died... 16:34:27.497314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6330): Terminated: ok {rc=0} 16:34:27.544443 --- ParallelTerminationStrategy: PID 6333 died... 16:34:27.564876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6333): Terminated: ok {rc=0} 16:34:27.611596 --- ParallelTerminationStrategy: PID 6336 died... 16:34:27.631800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6336): Terminated: ok {rc=0} 16:34:27.721087 bus /sierra_3: Setting Powered False 16:34:28.819389 bus /sierra_3: Setting Powered False 16:34:29.937062 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:34:31.085303 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:31.098117 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:34:31.166829 tst mo_mt_call_osmux.py: using LAC 34871 16:34:31.300928 tst mo_mt_call_osmux.py: using RAC 191 16:34:31.428388 tst mo_mt_call_osmux.py: using CellId 34871 16:34:31.558391 tst mo_mt_call_osmux.py: using BVCI 34872 16:34:31.726860 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:31.742852 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:31.754512 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:31.766598 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:31.778881 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:34:31.790971 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:34:31.912568 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:34:32.039436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:32.549563 run create_hlr_db(pid=6339): Launched 16:34:32.682539 bus /sierra_2: Setting Powered False 16:34:33.748828 run create_hlr_db(pid=6339): Terminated: ok {rc=0} 16:34:34.198164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6342): Launched 16:34:34.514036 run osmo-hlr_10.42.42.2(pid=6343): Launched 16:34:34.634070 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:35.191249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6345): Launched 16:34:35.507535 run osmo-stp_10.42.42.5(pid=6346): Launched 16:34:35.629681 run osmo-msc_10.42.42.6: Starting osmo-msc 16:34:36.195646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6348): Launched 16:34:36.511224 run osmo-msc_10.42.42.6(pid=6349): Launched 16:34:36.688462 run osmo-stp_10.42.42.5(pid=6346): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6346)] 16:34:36.820914 run osmo-stp_10.42.42.5(pid=6346): stdout: | (launched: 2022-12-13_16:34:35.449267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:36.952709 run osmo-stp_10.42.42.5(pid=6346): stderr: | [0;m[38;5;43m20221213163435619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163435620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163435620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163435620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163435621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163435621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163435621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:37.082867 run osmo-stp_10.42.42.5(pid=6346): stdout: | (launched: 2022-12-13_16:34:35.449267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:37.207070 run osmo-stp_10.42.42.5(pid=6346): stderr: | [0;m[38;5;43m20221213163435619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163435620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163435620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163435620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163435621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163435621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163435621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:37.356024 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6346): Process ended prematurely: osmo-stp_10.42.42.5(pid=6346) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6346)] [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:34:37.365222 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:34:37.392155 run osmo-hlr_10.42.42.2(pid=6343): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6343)] 16:34:37.440117 run osmo-hlr_10.42.42.2(pid=6343): stdout: | (launched: 2022-12-13_16:34:34.455674) 16:34:37.489751 run osmo-hlr_10.42.42.2(pid=6343): stderr: | [0;m[1;31m20221213163434634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163434634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163434634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163434634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163434634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163434634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163434647 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163434656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163434656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163434656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:37.559918 run osmo-msc_10.42.42.6(pid=6349): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6349)] 16:34:37.607892 run osmo-msc_10.42.42.6(pid=6349): stdout: | (launched: 2022-12-13_16:34:36.452533) 16:34:37.657344 run osmo-msc_10.42.42.6(pid=6349): stderr: | [0;m[38;5;43m20221213163436725 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163436726 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdb6cabac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163436726 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163436726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163436726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163436726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163436728 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163436728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163436728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163436728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:34:37.707240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6342): Terminating (SIGTERM) 16:34:37.746916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6345): Terminating (SIGTERM) 16:34:37.787202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6348): Terminating (SIGTERM) 16:34:37.827277 --- ParallelTerminationStrategy: PID 6342 died... 16:34:37.846723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6342): Terminated: ok {rc=0} 16:34:37.891028 --- ParallelTerminationStrategy: PID 6345 died... 16:34:37.909953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6345): Terminated: ok {rc=0} 16:34:37.954025 --- ParallelTerminationStrategy: PID 6348 died... 16:34:37.972873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6348): Terminated: ok {rc=0} 16:34:38.059370 bus /sierra_3: Setting Powered False 16:34:39.159729 bus /sierra_3: Setting Powered False 16:34:40.276705 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 16:34:41.524384 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:34:41.530363 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:34:41.561752 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:34:41.590948 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 16:34:41.679637 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:34:41.709930 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:34:41.738063 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 16:34:42.326781 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2391 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 16:34:42.332378 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:42.344467 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:34:42.396673 tst emergency_mo_mt_call.py: using LAC 34872 16:34:42.518158 tst emergency_mo_mt_call.py: using RAC 192 16:34:42.637404 tst emergency_mo_mt_call.py: using CellId 34872 16:34:42.759759 tst emergency_mo_mt_call.py: using BVCI 34873 16:34:42.870899 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:42.881956 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:42.892705 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:42.903484 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:42.914276 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:42.925035 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:34:43.047293 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:34:43.165639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:43.646534 run create_hlr_db(pid=6354): Launched 16:34:43.775002 bus /sierra_2: Setting Powered False 16:34:44.836511 run create_hlr_db(pid=6354): Terminated: ok {rc=0} 16:34:45.269932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6356): Launched 16:34:45.581651 run osmo-hlr_10.42.42.2(pid=6357): Launched 16:34:45.699092 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:46.253935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6359): Launched 16:34:46.601393 run osmo-stp_10.42.42.5(pid=6360): Launched 16:34:46.866201 tst emergency_mo_mt_call.py: using MSISDN 8222 16:34:47.103676 run osmo-msc_10.42.42.6: Starting osmo-msc 16:34:47.709754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6362): Launched 16:34:48.043781 run osmo-msc_10.42.42.6(pid=6363): Launched 16:34:48.231227 run osmo-stp_10.42.42.5(pid=6360): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6360)] 16:34:48.371336 run osmo-stp_10.42.42.5(pid=6360): stdout: | (launched: 2022-12-13_16:34:46.539818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:48.511193 run osmo-stp_10.42.42.5(pid=6360): stderr: | [0;m[38;5;43m20221213163446835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163446835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163446835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163446836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163446836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163446836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163446836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:48.649440 run osmo-stp_10.42.42.5(pid=6360): stdout: | (launched: 2022-12-13_16:34:46.539818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:48.781361 run osmo-stp_10.42.42.5(pid=6360): stderr: | [0;m[38;5;43m20221213163446835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163446835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163446835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163446836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163446836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163446836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163446836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:48.939000 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6360): Process ended prematurely: osmo-stp_10.42.42.5(pid=6360) [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6360)] [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 16:34:48.948273 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 16:34:48.976557 run osmo-hlr_10.42.42.2(pid=6357): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6357)] 16:34:49.028503 run osmo-hlr_10.42.42.2(pid=6357): stdout: | (launched: 2022-12-13_16:34:45.523863) 16:34:49.081347 run osmo-hlr_10.42.42.2(pid=6357): stderr: | [0;m[1;31m20221213163445699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163445699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163445699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163445699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163445699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163445699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163445710 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163445718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163445718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163445718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:49.154652 run osmo-msc_10.42.42.6(pid=6363): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6363)] 16:34:49.205465 run osmo-msc_10.42.42.6(pid=6363): stdout: | (launched: 2022-12-13_16:34:47.982606) 16:34:49.258040 run osmo-msc_10.42.42.6(pid=6363): stderr: | [0;m[38;5;43m20221213163448304 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163448304 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f03a94c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163448304 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163448304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163448304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163448305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163448306 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163448307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163448307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163448307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:34:49.311200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6356): Terminating (SIGTERM) 16:34:49.353811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6359): Terminating (SIGTERM) 16:34:49.396416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6362): Terminating (SIGTERM) 16:34:49.439423 --- ParallelTerminationStrategy: PID 6356 died... 16:34:49.460255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6356): Terminated: ok {rc=0} 16:34:49.507545 --- ParallelTerminationStrategy: PID 6359 died... 16:34:49.527930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6359): Terminated: ok {rc=0} 16:34:49.574920 --- ParallelTerminationStrategy: PID 6362 died... 16:34:49.595152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6362): Terminated: ok {rc=0} 16:34:49.685552 bus /sierra_3: Setting Powered False 16:34:50.786311 bus /sierra_3: Setting Powered False 16:34:51.905972 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 16:34:52.995629 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:53.008143 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:34:53.057383 tst emergency_preemptive_call.py: using LAC 34873 16:34:53.187463 tst emergency_preemptive_call.py: using RAC 193 16:34:53.318282 tst emergency_preemptive_call.py: using CellId 34873 16:34:53.449368 tst emergency_preemptive_call.py: using BVCI 34874 16:34:53.569107 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:53.580634 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:53.591984 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:53.603251 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:53.614938 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:34:53.626556 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:34:53.750520 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:34:53.867343 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:34:53.984539 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:34:54.104249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:54.582505 run create_hlr_db(pid=6365): Launched 16:34:54.711236 bus /sierra_2: Setting Powered False 16:34:55.771395 run create_hlr_db(pid=6365): Terminated: ok {rc=0} 16:34:56.222861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6367): Launched 16:34:56.554781 run osmo-hlr_10.42.42.2(pid=6368): Launched 16:34:56.683001 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:57.251242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6370): Launched 16:34:57.584512 run osmo-stp_10.42.42.5(pid=6371): Launched 16:34:57.722595 tst emergency_preemptive_call.py: using MSISDN 8223 16:34:57.898515 run osmo-msc_10.42.42.6: Starting osmo-msc 16:34:58.492047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6373): Launched 16:34:58.824631 run osmo-msc_10.42.42.6(pid=6374): Launched 16:34:59.011328 run osmo-stp_10.42.42.5(pid=6371): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6371)] 16:34:59.150827 run osmo-stp_10.42.42.5(pid=6371): stdout: | (launched: 2022-12-13_16:34:57.523693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:59.290883 run osmo-stp_10.42.42.5(pid=6371): stderr: | [0;m[38;5;43m20221213163457713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163457714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163457714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163457714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163457715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163457715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163457716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:59.429282 run osmo-stp_10.42.42.5(pid=6371): stdout: | (launched: 2022-12-13_16:34:57.523693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:59.561100 run osmo-stp_10.42.42.5(pid=6371): stderr: | [0;m[38;5;43m20221213163457713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163457714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163457714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163457714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163457715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163457715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163457716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:59.718461 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6371): Process ended prematurely: osmo-stp_10.42.42.5(pid=6371) [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6371)] [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 16:34:59.728152 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 16:34:59.757030 run osmo-hlr_10.42.42.2(pid=6368): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6368)] 16:34:59.808890 run osmo-hlr_10.42.42.2(pid=6368): stdout: | (launched: 2022-12-13_16:34:56.493804) 16:34:59.861925 run osmo-hlr_10.42.42.2(pid=6368): stderr: | [0;m[1;31m20221213163456689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163456689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163456689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163456689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163456689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163456689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163456702 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163456711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163456711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163456711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:59.935813 run osmo-msc_10.42.42.6(pid=6374): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6374)] 16:34:59.986791 run osmo-msc_10.42.42.6(pid=6374): stdout: | (launched: 2022-12-13_16:34:58.763429) 16:35:00.039466 run osmo-msc_10.42.42.6(pid=6374): stderr: | [0;m[38;5;43m20221213163459083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163459084 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90f13f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163459084 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163459084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163459084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163459084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163459086 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163459086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163459087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163459087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:35:00.092626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6367): Terminating (SIGTERM) 16:35:00.134880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6370): Terminating (SIGTERM) 16:35:00.177721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6373): Terminating (SIGTERM) 16:35:00.220762 --- ParallelTerminationStrategy: PID 6367 died... 16:35:00.241618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6367): Terminated: ok {rc=0} 16:35:00.288590 --- ParallelTerminationStrategy: PID 6370 died... 16:35:00.308692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6370): Terminated: ok {rc=0} 16:35:00.355898 --- ParallelTerminationStrategy: PID 6373 died... 16:35:00.375916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6373): Terminated: ok {rc=0} 16:35:00.464456 bus /sierra_9: Setting Powered False 16:35:01.562259 bus /sierra_9: Setting Powered False 16:35:02.681973 bus /sierra_8: Setting Powered False 16:35:03.781680 bus /sierra_8: Setting Powered False 16:35:04.896560 bus /sierra_3: Setting Powered False 16:35:05.995371 bus /sierra_3: Setting Powered False 16:35:07.114133 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 16:35:08.393836 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:35:08.398725 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:35:08.429140 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 16:35:08.470862 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 16:35:08.561185 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:35:08.591560 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 16:35:08.632425 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 16:35:09.227107 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 16:35:09.282554 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:09.294203 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:35:09.341253 tst cs_paging_gprs_active.py: using LAC 34874 16:35:09.474524 tst cs_paging_gprs_active.py: using RAC 194 16:35:09.607025 tst cs_paging_gprs_active.py: using CellId 34874 16:35:09.740745 tst cs_paging_gprs_active.py: using BVCI 34875 16:35:09.864407 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:09.876146 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:09.887425 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:09.898706 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:09.910222 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:09.921795 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:09.933627 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:09.945093 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:09.956849 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:35:10.083246 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:35:10.205151 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:35:10.419166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:10.736343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6382): Launched 16:35:11.012406 run iperf3-srv_10.42.42.10(pid=6383): Launched 16:35:11.133145 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:35:11.344495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:11.661599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6384): Launched 16:35:11.938375 run iperf3-srv_10.42.42.10(pid=6385): Launched 16:35:12.056640 tst cs_paging_gprs_active.py:38: start network... 16:35:12.268297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:12.756092 run create_hlr_db(pid=6386): Launched 16:35:12.887170 bus /sierra_2: Setting Powered False 16:35:13.949465 run create_hlr_db(pid=6386): Terminated: ok {rc=0} 16:35:14.410160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6388): Launched 16:35:14.749343 run osmo-hlr_10.42.42.2(pid=6389): Launched 16:35:14.879285 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:15.464821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6391): Launched 16:35:15.805213 run osmo-stp_10.42.42.5(pid=6392): Launched 16:35:16.101941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:16.754840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6394): Launched 16:35:16.896816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:17.188875 run patchelf(pid=6395): Launched 16:35:17.389823 run osmo-stp_10.42.42.5(pid=6392): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6392)] 16:35:17.533293 run osmo-stp_10.42.42.5(pid=6392): stdout: | (launched: 2022-12-13_16:35:15.743092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:17.678118 run osmo-stp_10.42.42.5(pid=6392): stderr: | [0;m[38;5;43m20221213163516025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163516025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163516025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163516026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163516026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163516026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163516026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:17.823002 run osmo-stp_10.42.42.5(pid=6392): stdout: | (launched: 2022-12-13_16:35:15.743092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:17.961290 run osmo-stp_10.42.42.5(pid=6392): stderr: | [0;m[38;5;43m20221213163516025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163516025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163516025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163516026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163516026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163516026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163516026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:18.125088 run patchelf(pid=6395): Terminating (SIGINT) 16:35:18.314609 run patchelf(pid=6395): Terminated: ok {rc=0} 16:35:18.451849 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6392): Process ended prematurely: osmo-stp_10.42.42.5(pid=6392) [trial-2391↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6392)] [trial-2391↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 16:35:18.462463 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 16:35:18.491745 run osmo-hlr_10.42.42.2(pid=6389): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6389)] 16:35:18.543369 run osmo-hlr_10.42.42.2(pid=6389): stdout: | (launched: 2022-12-13_16:35:14.687013) 16:35:18.596344 run osmo-hlr_10.42.42.2(pid=6389): stderr: | [0;m[1;31m20221213163514884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163514884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163514884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163514884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163514884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163514884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163514897 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163514905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163514905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163514905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:18.649705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6382): Terminating (SIGTERM) 16:35:18.692248 run iperf3-srv_10.42.42.10(pid=6383): Terminating (SIGTERM) 16:35:18.735463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6384): Terminating (SIGTERM) 16:35:18.778958 run iperf3-srv_10.42.42.10(pid=6385): Terminating (SIGTERM) 16:35:18.821918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6388): Terminating (SIGTERM) 16:35:18.864871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6391): Terminating (SIGTERM) 16:35:18.907793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6394): Terminating (SIGTERM) 16:35:18.951177 --- ParallelTerminationStrategy: PID 6382 died... 16:35:18.971758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6382): Terminated: ok {rc=0} 16:35:19.019263 --- ParallelTerminationStrategy: PID 6383 died... 16:35:19.039791 run iperf3-srv_10.42.42.10(pid=6383): Terminated {rc=256} 16:35:19.087302 --- ParallelTerminationStrategy: PID 6384 died... 16:35:19.107322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6384): Terminated: ok {rc=0} 16:35:19.154040 --- ParallelTerminationStrategy: PID 6385 died... 16:35:19.174097 run iperf3-srv_10.42.42.10(pid=6385): Terminated {rc=256} 16:35:19.220824 --- ParallelTerminationStrategy: PID 6388 died... 16:35:19.241302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6388): Terminated: ok {rc=0} 16:35:19.289132 --- ParallelTerminationStrategy: PID 6391 died... 16:35:19.309715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6391): Terminated: ok {rc=0} 16:35:19.357345 --- ParallelTerminationStrategy: PID 6394 died... 16:35:19.377566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6394): Terminated: ok {rc=0} 16:35:19.467430 bus /gobi_0: Setting Powered False 16:35:20.567960 bus /gobi_0: Setting Powered False 16:35:21.685543 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 16:35:22.838218 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:22.850442 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:35:22.900405 tst iperf3.py: using LAC 34875 16:35:23.032290 tst iperf3.py: using RAC 195 16:35:23.163257 tst iperf3.py: using CellId 34875 16:35:23.295415 tst iperf3.py: using BVCI 34876 16:35:23.418819 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:23.430336 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:23.441562 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:23.453159 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:23.464527 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:23.476001 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:23.487725 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:23.499161 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:23.510789 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:35:23.630151 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:35:23.842169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:24.159350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6396): Launched 16:35:24.436517 run iperf3-srv_10.42.42.10(pid=6397): Launched 16:35:24.558287 tst iperf3.py:8: start network... 16:35:24.769101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:25.257184 run create_hlr_db(pid=6398): Launched 16:35:25.387974 bus /gobi_6: Setting Powered False 16:35:26.450876 run create_hlr_db(pid=6398): Terminated: ok {rc=0} 16:35:26.888675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6400): Launched 16:35:27.206964 run osmo-hlr_10.42.42.2(pid=6401): Launched 16:35:27.326519 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:27.869740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6403): Launched 16:35:28.187922 run osmo-stp_10.42.42.5(pid=6404): Launched 16:35:28.309976 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:28.853946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6406): Launched 16:35:28.976904 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:29.244605 run patchelf(pid=6407): Launched 16:35:29.422219 run osmo-stp_10.42.42.5(pid=6404): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6404)] 16:35:29.555171 run osmo-stp_10.42.42.5(pid=6404): stdout: | (launched: 2022-12-13_16:35:28.128705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:29.690633 run osmo-stp_10.42.42.5(pid=6404): stderr: | [0;m[38;5;43m20221213163528298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163528298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163528298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163528298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163528299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163528299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163528299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:29.825884 run osmo-stp_10.42.42.5(pid=6404): stdout: | (launched: 2022-12-13_16:35:28.128705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:29.954928 run osmo-stp_10.42.42.5(pid=6404): stderr: | [0;m[38;5;43m20221213163528298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163528298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163528298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163528298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163528299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163528299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163528299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:30.108489 run patchelf(pid=6407): Terminating (SIGINT) 16:35:30.286623 run patchelf(pid=6407): Terminated: ok {rc=0} 16:35:30.414905 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6404): Process ended prematurely: osmo-stp_10.42.42.5(pid=6404) [trial-2391↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6404)] [trial-2391↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 16:35:30.424537 tst iperf3.py:8: Test FAILED (7.6 sec) 16:35:30.452353 run osmo-hlr_10.42.42.2(pid=6401): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6401)] 16:35:30.500814 run osmo-hlr_10.42.42.2(pid=6401): stdout: | (launched: 2022-12-13_16:35:27.147742) 16:35:30.550858 run osmo-hlr_10.42.42.2(pid=6401): stderr: | [0;m[1;31m20221213163527323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163527323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163527324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163527324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163527324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163527324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163527372 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163527381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163527381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163527381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:30.602211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6396): Terminating (SIGTERM) 16:35:30.642477 run iperf3-srv_10.42.42.10(pid=6397): Terminating (SIGTERM) 16:35:30.682902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6400): Terminating (SIGTERM) 16:35:30.723280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6403): Terminating (SIGTERM) 16:35:30.764234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6406): Terminating (SIGTERM) 16:35:30.804729 --- ParallelTerminationStrategy: PID 6396 died... 16:35:30.824281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6396): Terminated: ok {rc=0} 16:35:30.895067 --- ParallelTerminationStrategy: PID 6397 died... 16:35:30.914800 run iperf3-srv_10.42.42.10(pid=6397): Terminated {rc=256} 16:35:30.960255 --- ParallelTerminationStrategy: PID 6400 died... 16:35:30.979766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6400): Terminated: ok {rc=0} 16:35:31.029874 --- ParallelTerminationStrategy: PID 6403 died... 16:35:31.053095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6403): Terminated: ok {rc=0} 16:35:31.108336 --- ParallelTerminationStrategy: PID 6406 died... 16:35:31.132168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6406): Terminated: ok {rc=0} 16:35:31.236281 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 16:35:32.395944 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:32.408361 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:35:32.455259 tst iperf3m4.py: using LAC 34876 16:35:32.579431 tst iperf3m4.py: using RAC 196 16:35:32.704539 tst iperf3m4.py: using CellId 34876 16:35:32.825910 tst iperf3m4.py: using BVCI 34877 16:35:32.951687 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:32.963339 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:32.974904 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:32.986498 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:32.998795 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:33.010993 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:33.023446 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:33.035612 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:33.048129 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:35:33.170291 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:35:33.297080 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:35:33.418113 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:35:33.544353 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:35:33.755430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:34.071592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6408): Launched 16:35:34.348204 run iperf3-srv_10.42.42.10(pid=6409): Launched 16:35:34.466507 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:35:34.677786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:34.994949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6410): Launched 16:35:35.269703 run iperf3-srv_10.42.42.10(pid=6411): Launched 16:35:35.390033 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:35:35.600244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:35.915690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6412): Launched 16:35:36.193435 run iperf3-srv_10.42.42.10(pid=6413): Launched 16:35:36.311294 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:35:36.522618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:36.839244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6414): Launched 16:35:37.114220 run iperf3-srv_10.42.42.10(pid=6415): Launched 16:35:37.232679 tst iperf3m4.py:8: start network... 16:35:37.443113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:37.930804 run create_hlr_db(pid=6416): Launched 16:35:38.059726 bus /gobi_6: Setting Powered False 16:35:39.121498 run create_hlr_db(pid=6416): Terminated: ok {rc=0} 16:35:39.580496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6418): Launched 16:35:39.919928 run osmo-hlr_10.42.42.2(pid=6419): Launched 16:35:40.051682 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:40.737494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6421): Launched 16:35:41.070292 run osmo-stp_10.42.42.5(pid=6422): Launched 16:35:41.198420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:41.769562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6424): Launched 16:35:41.912735 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:42.192789 run patchelf(pid=6425): Launched 16:35:42.379066 run osmo-stp_10.42.42.5(pid=6422): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6422)] 16:35:42.518975 run osmo-stp_10.42.42.5(pid=6422): stdout: | (launched: 2022-12-13_16:35:41.009718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:42.660578 run osmo-stp_10.42.42.5(pid=6422): stderr: | [0;m[38;5;43m20221213163541198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163541199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163541199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163541199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163541200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163541200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163541200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:42.802261 run osmo-stp_10.42.42.5(pid=6422): stdout: | (launched: 2022-12-13_16:35:41.009718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:42.937482 run osmo-stp_10.42.42.5(pid=6422): stderr: | [0;m[38;5;43m20221213163541198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163541199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163541199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163541199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163541200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163541200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163541200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:43.097805 run patchelf(pid=6425): Terminating (SIGINT) 16:35:43.283512 run patchelf(pid=6425): Terminated: ok {rc=0} 16:35:43.418172 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6422): Process ended prematurely: osmo-stp_10.42.42.5(pid=6422) [trial-2391↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6422)] [trial-2391↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 16:35:43.428589 tst iperf3m4.py:8: Test FAILED (11.1 sec) 16:35:43.458069 run osmo-hlr_10.42.42.2(pid=6419): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6419)] 16:35:43.510162 run osmo-hlr_10.42.42.2(pid=6419): stdout: | (launched: 2022-12-13_16:35:39.857730) 16:35:43.562954 run osmo-hlr_10.42.42.2(pid=6419): stderr: | [0;m[1;31m20221213163540056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163540056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163540056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163540056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163540056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163540057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163540069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163540077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163540077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163540077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:43.616371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6408): Terminating (SIGTERM) 16:35:43.658635 run iperf3-srv_10.42.42.10(pid=6409): Terminating (SIGTERM) 16:35:43.701435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6410): Terminating (SIGTERM) 16:35:43.744257 run iperf3-srv_10.42.42.10(pid=6411): Terminating (SIGTERM) 16:35:43.787147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6412): Terminating (SIGTERM) 16:35:43.829774 run iperf3-srv_10.42.42.10(pid=6413): Terminating (SIGTERM) 16:35:43.872221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6414): Terminating (SIGTERM) 16:35:43.915144 run iperf3-srv_10.42.42.10(pid=6415): Terminating (SIGTERM) 16:35:43.957705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6418): Terminating (SIGTERM) 16:35:44.000269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6421): Terminating (SIGTERM) 16:35:44.043206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6424): Terminating (SIGTERM) 16:35:44.086294 --- ParallelTerminationStrategy: PID 6408 died... 16:35:44.107417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6408): Terminated: ok {rc=0} 16:35:44.154548 --- ParallelTerminationStrategy: PID 6409 died... 16:35:44.174853 run iperf3-srv_10.42.42.10(pid=6409): Terminated {rc=256} 16:35:44.221540 --- ParallelTerminationStrategy: PID 6410 died... 16:35:44.241719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6410): Terminated: ok {rc=0} 16:35:44.288329 --- ParallelTerminationStrategy: PID 6411 died... 16:35:44.308681 run iperf3-srv_10.42.42.10(pid=6411): Terminated {rc=256} 16:35:44.355517 --- ParallelTerminationStrategy: PID 6412 died... 16:35:44.376137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6412): Terminated: ok {rc=0} 16:35:44.422966 --- ParallelTerminationStrategy: PID 6413 died... 16:35:44.443343 run iperf3-srv_10.42.42.10(pid=6413): Terminated {rc=256} 16:35:44.490051 --- ParallelTerminationStrategy: PID 6414 died... 16:35:44.510304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6414): Terminated: ok {rc=0} 16:35:44.557196 --- ParallelTerminationStrategy: PID 6415 died... 16:35:44.577358 run iperf3-srv_10.42.42.10(pid=6415): Terminated {rc=256} 16:35:44.624178 --- ParallelTerminationStrategy: PID 6418 died... 16:35:44.645060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6418): Terminated: ok {rc=0} 16:35:44.691792 --- ParallelTerminationStrategy: PID 6421 died... 16:35:44.712119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6421): Terminated: ok {rc=0} 16:35:44.759133 --- ParallelTerminationStrategy: PID 6424 died... 16:35:44.779443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6424): Terminated: ok {rc=0} 16:35:44.868274 bus /gobi_4: Setting Powered False 16:35:45.968645 bus /gobi_4: Setting Powered False 16:35:47.095161 bus /gobi_1: Setting Powered False 16:35:48.196676 bus /gobi_1: Setting Powered False 16:35:49.313399 bus /gobi_0: Setting Powered False 16:35:50.411850 bus /gobi_0: Setting Powered False 16:35:51.529793 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 16:35:52.633282 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:52.645674 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:35:52.694459 tst ping.py: using LAC 34877 16:35:52.815363 tst ping.py: using RAC 197 16:35:52.935273 tst ping.py: using CellId 34877 16:35:53.055645 tst ping.py: using BVCI 34878 16:35:53.166395 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:53.177201 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:53.187914 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:53.198668 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:53.209191 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:53.219739 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:53.230560 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:35:53.241355 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:35:53.360843 tst ping.py:19: start network... 16:35:53.581457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:54.086181 run create_hlr_db(pid=6426): Launched 16:35:54.212460 bus /gobi_6: Setting Powered False 16:35:55.277115 run create_hlr_db(pid=6426): Terminated: ok {rc=0} 16:35:55.714645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6428): Launched 16:35:56.021942 run osmo-hlr_10.42.42.2(pid=6429): Launched 16:35:56.138291 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:56.666855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6431): Launched 16:35:56.974639 run osmo-stp_10.42.42.5(pid=6432): Launched 16:35:57.092398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:57.617347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6434): Launched 16:35:57.733948 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:57.991747 run patchelf(pid=6435): Launched 16:35:58.161383 run osmo-stp_10.42.42.5(pid=6432): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6432)] 16:35:58.290652 run osmo-stp_10.42.42.5(pid=6432): stdout: | (launched: 2022-12-13_16:35:56.917440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:58.421286 run osmo-stp_10.42.42.5(pid=6432): stderr: | [0;m[38;5;43m20221213163557086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163557086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163557086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163557087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163557087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163557087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163557087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:58.552269 run osmo-stp_10.42.42.5(pid=6432): stdout: | (launched: 2022-12-13_16:35:56.917440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:58.676556 run osmo-stp_10.42.42.5(pid=6432): stderr: | [0;m[38;5;43m20221213163557086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163557086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163557086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163557087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163557087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163557087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163557087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:58.823953 run patchelf(pid=6435): Terminating (SIGINT) 16:35:58.994548 run patchelf(pid=6435): Terminated: ok {rc=0} 16:35:59.117551 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6432): Process ended prematurely: osmo-stp_10.42.42.5(pid=6432) [trial-2391↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6432)] [trial-2391↪gprs:trx-lms-limenet-micro↪ping.py:22] 16:35:59.126536 tst ping.py:22: Test FAILED (6.5 sec) 16:35:59.153230 run osmo-hlr_10.42.42.2(pid=6429): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6429)] 16:35:59.201060 run osmo-hlr_10.42.42.2(pid=6429): stdout: | (launched: 2022-12-13_16:35:55.964907) 16:35:59.250307 run osmo-hlr_10.42.42.2(pid=6429): stderr: | [0;m[1;31m20221213163556139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163556139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163556139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163556139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163556139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163556139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163556152 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163556162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163556163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163556163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:59.300077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6428): Terminating (SIGTERM) 16:35:59.339917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6431): Terminating (SIGTERM) 16:35:59.379711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6434): Terminating (SIGTERM) 16:35:59.420302 --- ParallelTerminationStrategy: PID 6428 died... 16:35:59.439456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6428): Terminated: ok {rc=0} 16:35:59.483400 --- ParallelTerminationStrategy: PID 6431 died... 16:35:59.502142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6431): Terminated: ok {rc=0} 16:35:59.545907 --- ParallelTerminationStrategy: PID 6434 died... 16:35:59.564537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6434): Terminated: ok {rc=0} 16:35:59.648900 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 16:36:00.735434 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:36:00.747803 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:36:00.798368 tst ping_idle_ping.py: using LAC 34878 16:36:00.937842 tst ping_idle_ping.py: using RAC 198 16:36:01.071093 tst ping_idle_ping.py: using CellId 34878 16:36:01.242911 tst ping_idle_ping.py: using BVCI 34879 16:36:01.367557 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:36:01.379950 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:36:01.391964 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:36:01.406258 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:36:01.418984 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:36:01.432346 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:36:01.444448 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:36:01.459816 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:36:01.581720 tst ping_idle_ping.py:24: start network... 16:36:01.824203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:02.382226 run create_hlr_db(pid=6436): Launched 16:36:02.510153 bus /gobi_6: Setting Powered False 16:36:03.574752 run create_hlr_db(pid=6436): Terminated: ok {rc=0} 16:36:04.013420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6438): Launched 16:36:04.321304 run osmo-hlr_10.42.42.2(pid=6439): Launched 16:36:04.438071 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:04.964630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6441): Launched 16:36:05.271686 run osmo-stp_10.42.42.5(pid=6442): Launched 16:36:05.390810 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:05.917741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6444): Launched 16:36:06.035002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:06.294425 run patchelf(pid=6445): Launched 16:36:06.466399 run osmo-stp_10.42.42.5(pid=6442): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6442)] 16:36:06.595957 run osmo-stp_10.42.42.5(pid=6442): stdout: | (launched: 2022-12-13_16:36:05.214589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:06.727527 run osmo-stp_10.42.42.5(pid=6442): stderr: | [0;m[38;5;43m20221213163605386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163605386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163605386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163605386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163605387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163605387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163605387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:06.859317 run osmo-stp_10.42.42.5(pid=6442): stdout: | (launched: 2022-12-13_16:36:05.214589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:06.984128 run osmo-stp_10.42.42.5(pid=6442): stderr: | [0;m[38;5;43m20221213163605386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163605386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163605386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163605386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163605387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163605387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163605387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:07.132027 run patchelf(pid=6445): Terminating (SIGINT) 16:36:07.303687 run patchelf(pid=6445): Terminated: ok {rc=0} 16:36:07.427684 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6442): Process ended prematurely: osmo-stp_10.42.42.5(pid=6442) [trial-2391↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6442)] [trial-2391↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 16:36:07.436751 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:36:07.463845 run osmo-hlr_10.42.42.2(pid=6439): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6439)] 16:36:07.512182 run osmo-hlr_10.42.42.2(pid=6439): stdout: | (launched: 2022-12-13_16:36:04.264083) 16:36:07.561566 run osmo-hlr_10.42.42.2(pid=6439): stderr: | [0;m[1;31m20221213163604444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163604444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163604444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163604444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163604444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163604444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163604456 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163604465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163604465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163604465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:07.611610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6438): Terminating (SIGTERM) 16:36:07.651636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6441): Terminating (SIGTERM) 16:36:07.691396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6444): Terminating (SIGTERM) 16:36:07.731503 --- ParallelTerminationStrategy: PID 6438 died... 16:36:07.750811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6438): Terminated: ok {rc=0} 16:36:07.795137 --- ParallelTerminationStrategy: PID 6441 died... 16:36:07.814019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6441): Terminated: ok {rc=0} 16:36:07.858013 --- ParallelTerminationStrategy: PID 6444 died... 16:36:07.876887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6444): Terminated: ok {rc=0} 16:36:07.961788 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 16:36:09.256299 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:36:09.261783 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:36:09.290998 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:36:09.329916 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:36:09.417698 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:36:09.446726 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:36:09.485263 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:36:10.081276 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:36:10.131287 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:10.142426 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:36:10.192206 tst cs_paging_gprs_active.py: using LAC 34879 16:36:10.313747 tst cs_paging_gprs_active.py: using RAC 199 16:36:10.434140 tst cs_paging_gprs_active.py: using CellId 34879 16:36:10.553783 tst cs_paging_gprs_active.py: using BVCI 34880 16:36:10.666267 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:10.677475 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:10.688389 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:10.699381 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:10.710380 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:10.721544 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:10.732739 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:10.743775 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:10.755131 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:36:10.877968 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:36:10.996821 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:36:11.206440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:11.519619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6449): Launched 16:36:11.793164 run iperf3-srv_10.42.42.10(pid=6450): Launched 16:36:11.910606 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:36:12.119551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:12.433921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6451): Launched 16:36:12.706704 run iperf3-srv_10.42.42.10(pid=6452): Launched 16:36:12.826078 tst cs_paging_gprs_active.py:38: start network... 16:36:13.035247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:13.520079 run create_hlr_db(pid=6453): Launched 16:36:13.647822 bus /gobi_6: Setting Powered False 16:36:14.709283 run create_hlr_db(pid=6453): Terminated: ok {rc=0} 16:36:15.164084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6455): Launched 16:36:15.500920 run osmo-hlr_10.42.42.2(pid=6456): Launched 16:36:15.631462 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:16.225846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6458): Launched 16:36:16.570110 run osmo-stp_10.42.42.5(pid=6459): Launched 16:36:16.824998 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:17.476088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6461): Launched 16:36:17.606726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:17.889394 run patchelf(pid=6462): Launched 16:36:18.076186 run osmo-stp_10.42.42.5(pid=6459): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6459)] 16:36:18.216827 run osmo-stp_10.42.42.5(pid=6459): stdout: | (launched: 2022-12-13_16:36:16.508007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:18.359825 run osmo-stp_10.42.42.5(pid=6459): stderr: | [0;m[38;5;43m20221213163616799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163616799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163616799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163616799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163616800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163616800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163616800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:18.502880 run osmo-stp_10.42.42.5(pid=6459): stdout: | (launched: 2022-12-13_16:36:16.508007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:18.638993 run osmo-stp_10.42.42.5(pid=6459): stderr: | [0;m[38;5;43m20221213163616799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163616799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163616799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163616799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163616800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163616800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163616800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:18.799876 run patchelf(pid=6462): Terminating (SIGINT) 16:36:18.986955 run patchelf(pid=6462): Terminated: ok {rc=0} 16:36:19.121940 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6459): Process ended prematurely: osmo-stp_10.42.42.5(pid=6459) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6459)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:36:19.132350 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:36:19.161330 run osmo-hlr_10.42.42.2(pid=6456): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6456)] 16:36:19.212393 run osmo-hlr_10.42.42.2(pid=6456): stdout: | (launched: 2022-12-13_16:36:15.439577) 16:36:19.264791 run osmo-hlr_10.42.42.2(pid=6456): stderr: | [0;m[1;31m20221213163615638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163615638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163615638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163615638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163615638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163615639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163615651 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163615661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163615661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163615662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:19.318066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6449): Terminating (SIGTERM) 16:36:19.360468 run iperf3-srv_10.42.42.10(pid=6450): Terminating (SIGTERM) 16:36:19.403252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6451): Terminating (SIGTERM) 16:36:19.445801 run iperf3-srv_10.42.42.10(pid=6452): Terminating (SIGTERM) 16:36:19.488491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6455): Terminating (SIGTERM) 16:36:19.531060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6458): Terminating (SIGTERM) 16:36:19.573881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6461): Terminating (SIGTERM) 16:36:19.616603 --- ParallelTerminationStrategy: PID 6449 died... 16:36:19.636647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6449): Terminated: ok {rc=0} 16:36:19.683496 --- ParallelTerminationStrategy: PID 6450 died... 16:36:19.703327 run iperf3-srv_10.42.42.10(pid=6450): Terminated {rc=256} 16:36:19.749763 --- ParallelTerminationStrategy: PID 6451 died... 16:36:19.769664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6451): Terminated: ok {rc=0} 16:36:19.815981 --- ParallelTerminationStrategy: PID 6452 died... 16:36:19.835805 run iperf3-srv_10.42.42.10(pid=6452): Terminated {rc=256} 16:36:19.882235 --- ParallelTerminationStrategy: PID 6455 died... 16:36:19.902166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6455): Terminated: ok {rc=0} 16:36:19.948734 --- ParallelTerminationStrategy: PID 6458 died... 16:36:19.968746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6458): Terminated: ok {rc=0} 16:36:20.015311 --- ParallelTerminationStrategy: PID 6461 died... 16:36:20.035477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6461): Terminated: ok {rc=0} 16:36:20.124306 bus /gobi_0: Setting Powered False 16:36:21.223060 bus /gobi_0: Setting Powered False 16:36:22.340469 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:36:23.492286 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:23.505015 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:36:23.554915 tst iperf3.py: using LAC 34880 16:36:23.685754 tst iperf3.py: using RAC 200 16:36:23.815653 tst iperf3.py: using CellId 34880 16:36:23.947576 tst iperf3.py: using BVCI 34881 16:36:24.068268 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:24.080303 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:24.092072 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:24.103787 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:24.115690 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:24.127552 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:24.139518 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:24.151245 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:24.163221 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:36:24.286612 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:36:24.511343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:24.844907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6463): Launched 16:36:25.136064 run iperf3-srv_10.42.42.10(pid=6464): Launched 16:36:25.262440 tst iperf3.py:8: start network... 16:36:25.487029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:26.001676 run create_hlr_db(pid=6465): Launched 16:36:26.130750 bus /gobi_6: Setting Powered False 16:36:27.196489 run create_hlr_db(pid=6465): Terminated: ok {rc=0} 16:36:27.642478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6467): Launched 16:36:27.956255 run osmo-hlr_10.42.42.2(pid=6468): Launched 16:36:28.075990 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:28.614047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6470): Launched 16:36:28.928853 run osmo-stp_10.42.42.5(pid=6471): Launched 16:36:29.049607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:29.585291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6473): Launched 16:36:29.706081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:29.970207 run patchelf(pid=6474): Launched 16:36:30.145211 run osmo-stp_10.42.42.5(pid=6471): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6471)] 16:36:30.277308 run osmo-stp_10.42.42.5(pid=6471): stdout: | (launched: 2022-12-13_16:36:28.870879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:30.411072 run osmo-stp_10.42.42.5(pid=6471): stderr: | [0;m[38;5;43m20221213163629042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163629043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163629043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163629043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163629044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163629044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163629044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:30.545646 run osmo-stp_10.42.42.5(pid=6471): stdout: | (launched: 2022-12-13_16:36:28.870879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:30.673187 run osmo-stp_10.42.42.5(pid=6471): stderr: | [0;m[38;5;43m20221213163629042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163629043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163629043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163629043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163629044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163629044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163629044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:30.823712 run patchelf(pid=6474): Terminating (SIGINT) 16:36:31.024767 run patchelf(pid=6474): Terminated: ok {rc=0} 16:36:31.163770 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6471): Process ended prematurely: osmo-stp_10.42.42.5(pid=6471) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6471)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 16:36:31.175076 tst iperf3.py:8: Test FAILED (7.7 sec) 16:36:31.205374 run osmo-hlr_10.42.42.2(pid=6468): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6468)] 16:36:31.260696 run osmo-hlr_10.42.42.2(pid=6468): stdout: | (launched: 2022-12-13_16:36:27.898223) 16:36:31.316069 run osmo-hlr_10.42.42.2(pid=6468): stderr: | [0;m[1;31m20221213163628077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163628077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163628077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163628077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163628077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163628077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163628090 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163628099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163628099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163628099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:31.373150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6463): Terminating (SIGTERM) 16:36:31.417600 run iperf3-srv_10.42.42.10(pid=6464): Terminating (SIGTERM) 16:36:31.466272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6467): Terminating (SIGTERM) 16:36:31.511721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6470): Terminating (SIGTERM) 16:36:31.560055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6473): Terminating (SIGTERM) 16:36:31.607553 --- ParallelTerminationStrategy: PID 6463 died... 16:36:31.630079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6463): Terminated: ok {rc=0} 16:36:31.680784 --- ParallelTerminationStrategy: PID 6464 died... 16:36:31.702086 run iperf3-srv_10.42.42.10(pid=6464): Terminated {rc=256} 16:36:31.753229 --- ParallelTerminationStrategy: PID 6467 died... 16:36:31.774867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6467): Terminated: ok {rc=0} 16:36:31.826112 --- ParallelTerminationStrategy: PID 6470 died... 16:36:31.849498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6470): Terminated: ok {rc=0} 16:36:31.903240 --- ParallelTerminationStrategy: PID 6473 died... 16:36:31.927530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6473): Terminated: ok {rc=0} 16:36:32.033561 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:36:33.189057 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:33.201279 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:36:33.247726 tst iperf3m4.py: using LAC 34881 16:36:33.368290 tst iperf3m4.py: using RAC 201 16:36:33.488369 tst iperf3m4.py: using CellId 34881 16:36:33.612495 tst iperf3m4.py: using BVCI 34882 16:36:33.724785 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:33.736082 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:33.746994 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:33.757973 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:33.769179 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:33.780145 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:33.791483 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:33.802597 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:33.814116 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:36:33.938384 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:36:34.061959 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:36:34.182482 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:36:34.300815 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:36:34.509939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:34.822491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6475): Launched 16:36:35.096835 run iperf3-srv_10.42.42.10(pid=6476): Launched 16:36:35.214406 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:36:35.422469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:35.735230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6477): Launched 16:36:36.009112 run iperf3-srv_10.42.42.10(pid=6478): Launched 16:36:36.125950 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:36:36.333609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:36.647464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6479): Launched 16:36:36.921106 run iperf3-srv_10.42.42.10(pid=6480): Launched 16:36:37.037833 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:36:37.245591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:37.558858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6481): Launched 16:36:37.832549 run iperf3-srv_10.42.42.10(pid=6482): Launched 16:36:37.949503 tst iperf3m4.py:8: start network... 16:36:38.157423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:38.640630 run create_hlr_db(pid=6483): Launched 16:36:38.769429 bus /gobi_6: Setting Powered False 16:36:39.830771 run create_hlr_db(pid=6483): Terminated: ok {rc=0} 16:36:40.284369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6485): Launched 16:36:40.622099 run osmo-hlr_10.42.42.2(pid=6486): Launched 16:36:40.750018 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:41.327395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6488): Launched 16:36:41.664290 run osmo-stp_10.42.42.5(pid=6489): Launched 16:36:41.792824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:42.368620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6491): Launched 16:36:42.499423 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:42.793376 run patchelf(pid=6492): Launched 16:36:42.975641 run osmo-stp_10.42.42.5(pid=6489): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6489)] 16:36:43.113819 run osmo-stp_10.42.42.5(pid=6489): stdout: | (launched: 2022-12-13_16:36:41.602741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:43.254334 run osmo-stp_10.42.42.5(pid=6489): stderr: | [0;m[38;5;43m20221213163641795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163641795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163641795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163641795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163641796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163641796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163641796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:43.394924 run osmo-stp_10.42.42.5(pid=6489): stdout: | (launched: 2022-12-13_16:36:41.602741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:43.529349 run osmo-stp_10.42.42.5(pid=6489): stderr: | [0;m[38;5;43m20221213163641795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163641795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163641795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163641795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163641796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163641796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163641796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:43.688223 run patchelf(pid=6492): Terminating (SIGINT) 16:36:43.871713 run patchelf(pid=6492): Terminated: ok {rc=0} 16:36:44.004072 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6489): Process ended prematurely: osmo-stp_10.42.42.5(pid=6489) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6489)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 16:36:44.014537 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:36:44.043566 run osmo-hlr_10.42.42.2(pid=6486): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6486)] 16:36:44.094497 run osmo-hlr_10.42.42.2(pid=6486): stdout: | (launched: 2022-12-13_16:36:40.560558) 16:36:44.146793 run osmo-hlr_10.42.42.2(pid=6486): stderr: | [0;m[1;31m20221213163640759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163640759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163640759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163640759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163640759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163640759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163640771 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163640781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163640781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163640781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:44.199804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6475): Terminating (SIGTERM) 16:36:44.242112 run iperf3-srv_10.42.42.10(pid=6476): Terminating (SIGTERM) 16:36:44.286562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6477): Terminating (SIGTERM) 16:36:44.329419 run iperf3-srv_10.42.42.10(pid=6478): Terminating (SIGTERM) 16:36:44.372216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6479): Terminating (SIGTERM) 16:36:44.414877 run iperf3-srv_10.42.42.10(pid=6480): Terminating (SIGTERM) 16:36:44.457559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6481): Terminating (SIGTERM) 16:36:44.499668 run iperf3-srv_10.42.42.10(pid=6482): Terminating (SIGTERM) 16:36:44.542908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6485): Terminating (SIGTERM) 16:36:44.586205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6488): Terminating (SIGTERM) 16:36:44.626352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6491): Terminating (SIGTERM) 16:36:44.666842 --- ParallelTerminationStrategy: PID 6475 died... 16:36:44.686454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6475): Terminated: ok {rc=0} 16:36:44.730820 --- ParallelTerminationStrategy: PID 6476 died... 16:36:44.750028 run iperf3-srv_10.42.42.10(pid=6476): Terminated {rc=256} 16:36:44.794013 --- ParallelTerminationStrategy: PID 6477 died... 16:36:44.812817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6477): Terminated: ok {rc=0} 16:36:44.856650 --- ParallelTerminationStrategy: PID 6478 died... 16:36:44.875726 run iperf3-srv_10.42.42.10(pid=6478): Terminated {rc=256} 16:36:44.919565 --- ParallelTerminationStrategy: PID 6479 died... 16:36:44.938759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6479): Terminated: ok {rc=0} 16:36:44.982894 --- ParallelTerminationStrategy: PID 6480 died... 16:36:45.001804 run iperf3-srv_10.42.42.10(pid=6480): Terminated {rc=256} 16:36:45.045768 --- ParallelTerminationStrategy: PID 6481 died... 16:36:45.064696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6481): Terminated: ok {rc=0} 16:36:45.108752 --- ParallelTerminationStrategy: PID 6482 died... 16:36:45.127894 run iperf3-srv_10.42.42.10(pid=6482): Terminated {rc=256} 16:36:45.171843 --- ParallelTerminationStrategy: PID 6485 died... 16:36:45.191046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6485): Terminated: ok {rc=0} 16:36:45.235516 --- ParallelTerminationStrategy: PID 6488 died... 16:36:45.254616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6488): Terminated: ok {rc=0} 16:36:45.298724 --- ParallelTerminationStrategy: PID 6491 died... 16:36:45.317998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6491): Terminated: ok {rc=0} 16:36:45.404742 bus /gobi_4: Setting Powered False 16:36:46.503568 bus /gobi_4: Setting Powered False 16:36:47.618806 bus /gobi_1: Setting Powered False 16:36:48.714768 bus /gobi_1: Setting Powered False 16:36:49.828691 bus /gobi_0: Setting Powered False 16:36:50.926471 bus /gobi_0: Setting Powered False 16:36:52.044770 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 16:36:53.148798 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:53.161193 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:36:53.210951 tst ping.py: using LAC 34882 16:36:53.329997 tst ping.py: using RAC 202 16:36:53.448724 tst ping.py: using CellId 34882 16:36:53.565593 tst ping.py: using BVCI 34883 16:36:53.674063 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:53.685287 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:53.696195 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:53.707336 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:53.718144 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:53.728914 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:53.740007 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:36:53.750922 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:36:53.866071 tst ping.py:19: start network... 16:36:54.066025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:54.529585 run create_hlr_db(pid=6493): Launched 16:36:54.652897 bus /gobi_6: Setting Powered False 16:36:55.713418 run create_hlr_db(pid=6493): Terminated: ok {rc=0} 16:36:56.151508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6495): Launched 16:36:56.472604 run osmo-hlr_10.42.42.2(pid=6496): Launched 16:36:56.595791 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:57.150569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6498): Launched 16:36:57.470976 run osmo-stp_10.42.42.5(pid=6499): Launched 16:36:57.593808 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:58.144823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6501): Launched 16:36:58.267323 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:58.539080 run patchelf(pid=6502): Launched 16:36:58.717653 run osmo-stp_10.42.42.5(pid=6499): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6499)] 16:36:58.853702 run osmo-stp_10.42.42.5(pid=6499): stdout: | (launched: 2022-12-13_16:36:57.411904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:58.991535 run osmo-stp_10.42.42.5(pid=6499): stderr: | [0;m[38;5;43m20221213163657602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163657602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163657602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163657603 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163657603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163657603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163657603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:59.129781 run osmo-stp_10.42.42.5(pid=6499): stdout: | (launched: 2022-12-13_16:36:57.411904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:59.261187 run osmo-stp_10.42.42.5(pid=6499): stderr: | [0;m[38;5;43m20221213163657602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163657602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163657602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163657603 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163657603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163657603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163657603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:59.417079 run patchelf(pid=6502): Terminating (SIGINT) 16:36:59.597601 run patchelf(pid=6502): Terminated: ok {rc=0} 16:36:59.727493 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6499): Process ended prematurely: osmo-stp_10.42.42.5(pid=6499) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6499)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 16:36:59.737137 tst ping.py:22: Test FAILED (6.6 sec) 16:36:59.765215 run osmo-hlr_10.42.42.2(pid=6496): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6496)] 16:36:59.816039 run osmo-hlr_10.42.42.2(pid=6496): stdout: | (launched: 2022-12-13_16:36:56.413392) 16:36:59.868202 run osmo-hlr_10.42.42.2(pid=6496): stderr: | [0;m[1;31m20221213163656610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163656610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163656610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163656610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163656610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163656610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163656623 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163656631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163656632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163656632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:59.920786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6495): Terminating (SIGTERM) 16:36:59.963095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6498): Terminating (SIGTERM) 16:37:00.005880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6501): Terminating (SIGTERM) 16:37:00.048338 --- ParallelTerminationStrategy: PID 6495 died... 16:37:00.068724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6495): Terminated: ok {rc=0} 16:37:00.115378 --- ParallelTerminationStrategy: PID 6498 died... 16:37:00.135238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6498): Terminated: ok {rc=0} 16:37:00.181602 --- ParallelTerminationStrategy: PID 6501 died... 16:37:00.201547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6501): Terminated: ok {rc=0} 16:37:00.290145 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:37:01.379510 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:37:01.395465 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:37:01.456526 tst ping_idle_ping.py: using LAC 34883 16:37:01.582266 tst ping_idle_ping.py: using RAC 203 16:37:01.740771 tst ping_idle_ping.py: using CellId 34883 16:37:01.871077 tst ping_idle_ping.py: using BVCI 34884 16:37:02.028192 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:37:02.039709 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:37:02.054469 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:37:02.072421 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:37:02.090296 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:37:02.108067 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:37:02.126227 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:37:02.143123 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:37:02.283038 tst ping_idle_ping.py:24: start network... 16:37:02.503000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:03.003443 run create_hlr_db(pid=6503): Launched 16:37:03.127006 bus /gobi_6: Setting Powered False 16:37:04.191447 run create_hlr_db(pid=6503): Terminated: ok {rc=0} 16:37:04.639499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6505): Launched 16:37:04.961805 run osmo-hlr_10.42.42.2(pid=6506): Launched 16:37:05.084750 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:05.641142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6508): Launched 16:37:05.963511 run osmo-stp_10.42.42.5(pid=6509): Launched 16:37:06.086568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:37:06.640084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6511): Launched 16:37:06.763495 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:37:07.035229 run patchelf(pid=6512): Launched 16:37:07.214913 run osmo-stp_10.42.42.5(pid=6509): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6509)] 16:37:07.351510 run osmo-stp_10.42.42.5(pid=6509): stdout: | (launched: 2022-12-13_16:37:05.904038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:07.490365 run osmo-stp_10.42.42.5(pid=6509): stderr: | [0;m[38;5;43m20221213163706092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163706092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163706093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163706093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163706094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163706094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163706094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:07.629065 run osmo-stp_10.42.42.5(pid=6509): stdout: | (launched: 2022-12-13_16:37:05.904038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:07.760666 run osmo-stp_10.42.42.5(pid=6509): stderr: | [0;m[38;5;43m20221213163706092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163706092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163706093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163706093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163706094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163706094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163706094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:07.916373 run patchelf(pid=6512): Terminating (SIGINT) 16:37:08.096904 run patchelf(pid=6512): Terminated: ok {rc=0} 16:37:08.227168 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6509): Process ended prematurely: osmo-stp_10.42.42.5(pid=6509) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6509)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 16:37:08.237063 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 16:37:08.265475 run osmo-hlr_10.42.42.2(pid=6506): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6506)] 16:37:08.316454 run osmo-hlr_10.42.42.2(pid=6506): stdout: | (launched: 2022-12-13_16:37:04.902662) 16:37:08.369138 run osmo-hlr_10.42.42.2(pid=6506): stderr: | [0;m[1;31m20221213163705097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163705097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163705097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163705097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163705097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163705097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163705110 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163705118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163705118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163705119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:08.422065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6505): Terminating (SIGTERM) 16:37:08.464516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6508): Terminating (SIGTERM) 16:37:08.507368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6511): Terminating (SIGTERM) 16:37:08.549877 --- ParallelTerminationStrategy: PID 6505 died... 16:37:08.570141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6505): Terminated: ok {rc=0} 16:37:08.616429 --- ParallelTerminationStrategy: PID 6508 died... 16:37:08.636202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6508): Terminated: ok {rc=0} 16:37:08.682275 --- ParallelTerminationStrategy: PID 6511 died... 16:37:08.702167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6511): Terminated: ok {rc=0} 16:37:08.790279 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:37:10.100092 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:10.106735 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:37:10.136743 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:37:10.177992 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:37:10.266223 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:37:10.298244 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:37:10.339300 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:37:10.930912 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:37:10.981197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:10.992348 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:37:11.058510 tst cs_paging_gprs_active.py: using LAC 34884 16:37:11.178839 tst cs_paging_gprs_active.py: using RAC 204 16:37:11.300728 tst cs_paging_gprs_active.py: using CellId 34884 16:37:11.422584 tst cs_paging_gprs_active.py: using BVCI 34885 16:37:11.533342 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:11.544355 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:11.555307 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:11.566345 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:11.577257 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:11.588118 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:11.599096 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:11.610080 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:11.621087 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:37:11.741298 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:37:11.866057 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:37:12.087400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:37:12.417380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6516): Launched 16:37:12.704174 run iperf3-srv_10.42.42.10(pid=6517): Launched 16:37:12.827320 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:37:13.048171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:37:13.377729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6518): Launched 16:37:13.664830 run iperf3-srv_10.42.42.10(pid=6519): Launched 16:37:13.787745 tst cs_paging_gprs_active.py:38: start network... 16:37:14.008142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:14.515162 run create_hlr_db(pid=6520): Launched 16:37:14.641543 bus /gobi_6: Setting Powered False 16:37:15.706445 run create_hlr_db(pid=6520): Terminated: ok {rc=0} 16:37:16.184615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6522): Launched 16:37:16.527796 run osmo-hlr_10.42.42.2(pid=6523): Launched 16:37:16.775978 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:17.421642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6525): Launched 16:37:17.730566 run osmo-stp_10.42.42.5(pid=6526): Launched 16:37:17.847003 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:37:18.376128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6528): Launched 16:37:18.494153 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:37:18.753818 run patchelf(pid=6529): Launched 16:37:18.925908 run osmo-stp_10.42.42.5(pid=6526): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6526)] 16:37:19.055939 run osmo-stp_10.42.42.5(pid=6526): stdout: | (launched: 2022-12-13_16:37:17.673461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:19.187213 run osmo-stp_10.42.42.5(pid=6526): stderr: | [0;m[38;5;43m20221213163717843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163717843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163717844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163717844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163717845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163717845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163717845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:19.318313 run osmo-stp_10.42.42.5(pid=6526): stdout: | (launched: 2022-12-13_16:37:17.673461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:19.444210 run osmo-stp_10.42.42.5(pid=6526): stderr: | [0;m[38;5;43m20221213163717843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163717843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163717844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163717844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163717845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163717845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163717845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:19.592443 run patchelf(pid=6529): Terminating (SIGINT) 16:37:19.765931 run patchelf(pid=6529): Terminated: ok {rc=0} 16:37:19.890483 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6526): Process ended prematurely: osmo-stp_10.42.42.5(pid=6526) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6526)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:37:19.900106 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:37:19.927398 run osmo-hlr_10.42.42.2(pid=6523): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6523)] 16:37:19.974886 run osmo-hlr_10.42.42.2(pid=6523): stdout: | (launched: 2022-12-13_16:37:16.464830) 16:37:20.023706 run osmo-hlr_10.42.42.2(pid=6523): stderr: | [0;m[1;31m20221213163716767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163716767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163716767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163716767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163716767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163716767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163716788 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163716813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163716813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163716814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:20.073177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6516): Terminating (SIGTERM) 16:37:20.112897 run iperf3-srv_10.42.42.10(pid=6517): Terminating (SIGTERM) 16:37:20.152278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6518): Terminating (SIGTERM) 16:37:20.191691 run iperf3-srv_10.42.42.10(pid=6519): Terminating (SIGTERM) 16:37:20.231174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6522): Terminating (SIGTERM) 16:37:20.270783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6525): Terminating (SIGTERM) 16:37:20.310303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6528): Terminating (SIGTERM) 16:37:20.350125 --- ParallelTerminationStrategy: PID 6516 died... 16:37:20.369346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6516): Terminated: ok {rc=0} 16:37:20.413234 --- ParallelTerminationStrategy: PID 6517 died... 16:37:20.431810 run iperf3-srv_10.42.42.10(pid=6517): Terminated {rc=256} 16:37:20.475259 --- ParallelTerminationStrategy: PID 6518 died... 16:37:20.493958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6518): Terminated: ok {rc=0} 16:37:20.537127 --- ParallelTerminationStrategy: PID 6519 died... 16:37:20.555362 run iperf3-srv_10.42.42.10(pid=6519): Terminated {rc=256} 16:37:20.598801 --- ParallelTerminationStrategy: PID 6522 died... 16:37:20.617322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6522): Terminated: ok {rc=0} 16:37:20.660593 --- ParallelTerminationStrategy: PID 6525 died... 16:37:20.679178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6525): Terminated: ok {rc=0} 16:37:20.722621 --- ParallelTerminationStrategy: PID 6528 died... 16:37:20.741060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6528): Terminated: ok {rc=0} 16:37:20.826611 bus /gobi_0: Setting Powered False 16:37:21.926129 bus /gobi_0: Setting Powered False 16:37:23.040137 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:37:24.189825 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:24.202410 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:37:24.274366 tst iperf3.py: using LAC 34885 16:37:24.402880 tst iperf3.py: using RAC 205 16:37:24.531230 tst iperf3.py: using CellId 34885 16:37:24.654354 tst iperf3.py: using BVCI 34886 16:37:24.767586 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:24.778890 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:24.790541 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:24.801651 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:24.813192 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:24.824542 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:24.836034 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:24.847427 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:24.858921 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:37:24.978894 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:37:25.199014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:37:25.527254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6530): Launched 16:37:25.812271 run iperf3-srv_10.42.42.10(pid=6531): Launched 16:37:25.934824 tst iperf3.py:8: start network... 16:37:26.154892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:26.660556 run create_hlr_db(pid=6532): Launched 16:37:26.784436 bus /gobi_6: Setting Powered False 16:37:27.848730 run create_hlr_db(pid=6532): Terminated: ok {rc=0} 16:37:28.283237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6534): Launched 16:37:28.590304 run osmo-hlr_10.42.42.2(pid=6535): Launched 16:37:28.707288 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:29.253841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6537): Launched 16:37:29.561651 run osmo-stp_10.42.42.5(pid=6538): Launched 16:37:29.678970 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:37:30.205369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6540): Launched 16:37:30.322795 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:37:30.581484 run patchelf(pid=6541): Launched 16:37:30.751896 run osmo-stp_10.42.42.5(pid=6538): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6538)] 16:37:30.882223 run osmo-stp_10.42.42.5(pid=6538): stdout: | (launched: 2022-12-13_16:37:29.504557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:31.017148 run osmo-stp_10.42.42.5(pid=6538): stderr: | [0;m[38;5;43m20221213163729673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163729674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163729674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163729674 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163729675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163729675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163729675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:31.151223 run osmo-stp_10.42.42.5(pid=6538): stdout: | (launched: 2022-12-13_16:37:29.504557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:31.279126 run osmo-stp_10.42.42.5(pid=6538): stderr: | [0;m[38;5;43m20221213163729673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163729674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163729674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163729674 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163729675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163729675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163729675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:31.430862 run patchelf(pid=6541): Terminating (SIGINT) 16:37:31.607322 run patchelf(pid=6541): Terminated: ok {rc=0} 16:37:31.734214 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6538): Process ended prematurely: osmo-stp_10.42.42.5(pid=6538) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6538)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 16:37:31.744656 tst iperf3.py:8: Test FAILED (7.6 sec) 16:37:31.772792 run osmo-hlr_10.42.42.2(pid=6535): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6535)] 16:37:31.821741 run osmo-hlr_10.42.42.2(pid=6535): stdout: | (launched: 2022-12-13_16:37:28.534011) 16:37:31.871942 run osmo-hlr_10.42.42.2(pid=6535): stderr: | [0;m[1;31m20221213163728706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163728706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163728706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163728706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163728706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163728707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163728719 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163728727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163728727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163728727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:31.923054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6530): Terminating (SIGTERM) 16:37:31.964228 run iperf3-srv_10.42.42.10(pid=6531): Terminating (SIGTERM) 16:37:32.008066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6534): Terminating (SIGTERM) 16:37:32.049248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6537): Terminating (SIGTERM) 16:37:32.090447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6540): Terminating (SIGTERM) 16:37:32.133181 --- ParallelTerminationStrategy: PID 6530 died... 16:37:32.152509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6530): Terminated: ok {rc=0} 16:37:32.196888 --- ParallelTerminationStrategy: PID 6531 died... 16:37:32.215905 run iperf3-srv_10.42.42.10(pid=6531): Terminated {rc=256} 16:37:32.260282 --- ParallelTerminationStrategy: PID 6534 died... 16:37:32.279088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6534): Terminated: ok {rc=0} 16:37:32.322457 --- ParallelTerminationStrategy: PID 6537 died... 16:37:32.340836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6537): Terminated: ok {rc=0} 16:37:32.384315 --- ParallelTerminationStrategy: PID 6540 died... 16:37:32.402986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6540): Terminated: ok {rc=0} 16:37:32.485495 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:37:33.634514 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:33.647463 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:37:33.716782 tst iperf3m4.py: using LAC 34886 16:37:33.843802 tst iperf3m4.py: using RAC 206 16:37:33.971993 tst iperf3m4.py: using CellId 34886 16:37:34.099399 tst iperf3m4.py: using BVCI 34887 16:37:34.217871 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:34.229491 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:34.240750 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:34.252249 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:34.263880 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:34.275587 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:34.287471 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:34.299183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:34.311087 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:37:34.432295 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:37:34.555394 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:37:34.676267 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:37:34.794200 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:37:34.999887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:37:35.307326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6542): Launched 16:37:35.573986 run iperf3-srv_10.42.42.10(pid=6543): Launched 16:37:35.689181 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:37:35.893956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:37:36.200843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6544): Launched 16:37:36.467202 run iperf3-srv_10.42.42.10(pid=6545): Launched 16:37:36.582220 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:37:36.785927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:37:37.094069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6546): Launched 16:37:37.360681 run iperf3-srv_10.42.42.10(pid=6547): Launched 16:37:37.475618 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:37:37.679722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:37:37.986617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6548): Launched 16:37:38.253202 run iperf3-srv_10.42.42.10(pid=6549): Launched 16:37:38.368110 tst iperf3m4.py:8: start network... 16:37:38.572543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:39.046469 run create_hlr_db(pid=6550): Launched 16:37:39.171670 bus /gobi_6: Setting Powered False 16:37:40.232009 run create_hlr_db(pid=6550): Terminated: ok {rc=0} 16:37:40.677498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6552): Launched 16:37:41.004535 run osmo-hlr_10.42.42.2(pid=6553): Launched 16:37:41.129457 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:41.694374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6555): Launched 16:37:42.021478 run osmo-stp_10.42.42.5(pid=6556): Launched 16:37:42.146689 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:37:42.710500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6558): Launched 16:37:42.832654 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:37:43.092484 run patchelf(pid=6559): Launched 16:37:43.263159 run osmo-stp_10.42.42.5(pid=6556): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6556)] 16:37:43.393111 run osmo-stp_10.42.42.5(pid=6556): stdout: | (launched: 2022-12-13_16:37:41.961639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:43.524517 run osmo-stp_10.42.42.5(pid=6556): stderr: | [0;m[38;5;43m20221213163742149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163742149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163742149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163742149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163742150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163742150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163742150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:43.656278 run osmo-stp_10.42.42.5(pid=6556): stdout: | (launched: 2022-12-13_16:37:41.961639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:43.781798 run osmo-stp_10.42.42.5(pid=6556): stderr: | [0;m[38;5;43m20221213163742149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163742149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163742149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163742149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163742150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163742150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163742150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:43.930535 run patchelf(pid=6559): Terminating (SIGINT) 16:37:44.102899 run patchelf(pid=6559): Terminated: ok {rc=0} 16:37:44.227064 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6556): Process ended prematurely: osmo-stp_10.42.42.5(pid=6556) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6556)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:37:44.236604 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:37:44.264041 run osmo-hlr_10.42.42.2(pid=6553): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6553)] 16:37:44.311273 run osmo-hlr_10.42.42.2(pid=6553): stdout: | (launched: 2022-12-13_16:37:40.944505) 16:37:44.360523 run osmo-hlr_10.42.42.2(pid=6553): stderr: | [0;m[1;31m20221213163741139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163741139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163741139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163741139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163741139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163741139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163741151 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163741160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163741161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163741161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:44.410002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6542): Terminating (SIGTERM) 16:37:44.449365 run iperf3-srv_10.42.42.10(pid=6543): Terminating (SIGTERM) 16:37:44.488585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6544): Terminating (SIGTERM) 16:37:44.527814 run iperf3-srv_10.42.42.10(pid=6545): Terminating (SIGTERM) 16:37:44.567021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6546): Terminating (SIGTERM) 16:37:44.606324 run iperf3-srv_10.42.42.10(pid=6547): Terminating (SIGTERM) 16:37:44.645655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6548): Terminating (SIGTERM) 16:37:44.684914 run iperf3-srv_10.42.42.10(pid=6549): Terminating (SIGTERM) 16:37:44.724091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6552): Terminating (SIGTERM) 16:37:44.763398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6555): Terminating (SIGTERM) 16:37:44.802635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6558): Terminating (SIGTERM) 16:37:44.842885 --- ParallelTerminationStrategy: PID 6542 died... 16:37:44.861808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6542): Terminated: ok {rc=0} 16:37:44.905382 --- ParallelTerminationStrategy: PID 6543 died... 16:37:44.923709 run iperf3-srv_10.42.42.10(pid=6543): Terminated {rc=256} 16:37:44.967186 --- ParallelTerminationStrategy: PID 6544 died... 16:37:44.985557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6544): Terminated: ok {rc=0} 16:37:45.028898 --- ParallelTerminationStrategy: PID 6545 died... 16:37:45.048138 run iperf3-srv_10.42.42.10(pid=6545): Terminated {rc=256} 16:37:45.091434 --- ParallelTerminationStrategy: PID 6546 died... 16:37:45.109908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6546): Terminated: ok {rc=0} 16:37:45.153349 --- ParallelTerminationStrategy: PID 6547 died... 16:37:45.171899 run iperf3-srv_10.42.42.10(pid=6547): Terminated {rc=256} 16:37:45.215112 --- ParallelTerminationStrategy: PID 6548 died... 16:37:45.233545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6548): Terminated: ok {rc=0} 16:37:45.276807 --- ParallelTerminationStrategy: PID 6549 died... 16:37:45.295720 run iperf3-srv_10.42.42.10(pid=6549): Terminated {rc=256} 16:37:45.339086 --- ParallelTerminationStrategy: PID 6552 died... 16:37:45.357586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6552): Terminated: ok {rc=0} 16:37:45.401435 --- ParallelTerminationStrategy: PID 6555 died... 16:37:45.419948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6555): Terminated: ok {rc=0} 16:37:45.463692 --- ParallelTerminationStrategy: PID 6558 died... 16:37:45.482351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6558): Terminated: ok {rc=0} 16:37:45.566496 bus /gobi_4: Setting Powered False 16:37:46.667339 bus /gobi_4: Setting Powered False 16:37:47.794543 bus /gobi_1: Setting Powered False 16:37:48.892458 bus /gobi_1: Setting Powered False 16:37:50.003981 bus /gobi_0: Setting Powered False 16:37:51.102834 bus /gobi_0: Setting Powered False 16:37:52.222714 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:37:53.325762 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:53.337849 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:37:53.404686 tst ping.py: using LAC 34887 16:37:53.523495 tst ping.py: using RAC 207 16:37:53.641505 tst ping.py: using CellId 34887 16:37:53.761958 tst ping.py: using BVCI 34888 16:37:53.871428 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:53.882832 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:53.894027 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:53.904904 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:53.916058 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:53.927229 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:53.938316 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:37:53.949275 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:37:54.069090 tst ping.py:19: start network... 16:37:54.285640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:54.781778 run create_hlr_db(pid=6560): Launched 16:37:54.905645 bus /gobi_6: Setting Powered False 16:37:55.968892 run create_hlr_db(pid=6560): Terminated: ok {rc=0} 16:37:56.398047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6562): Launched 16:37:56.698975 run osmo-hlr_10.42.42.2(pid=6563): Launched 16:37:56.813409 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:57.350403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6565): Launched 16:37:57.650520 run osmo-stp_10.42.42.5(pid=6566): Launched 16:37:57.766214 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:37:58.283784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6568): Launched 16:37:58.399211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:37:58.653840 run patchelf(pid=6569): Launched 16:37:58.822389 run osmo-stp_10.42.42.5(pid=6566): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6566)] 16:37:58.949900 run osmo-stp_10.42.42.5(pid=6566): stdout: | (launched: 2022-12-13_16:37:57.595005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:59.079748 run osmo-stp_10.42.42.5(pid=6566): stderr: | [0;m[38;5;43m20221213163757762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163757762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163757762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163757762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163757763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163757763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163757763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:59.209979 run osmo-stp_10.42.42.5(pid=6566): stdout: | (launched: 2022-12-13_16:37:57.595005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:59.333315 run osmo-stp_10.42.42.5(pid=6566): stderr: | [0;m[38;5;43m20221213163757762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163757762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163757762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163757762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163757763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163757763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163757763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:59.479695 run patchelf(pid=6569): Terminating (SIGINT) 16:37:59.648673 run patchelf(pid=6569): Terminated: ok {rc=0} 16:37:59.771321 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6566): Process ended prematurely: osmo-stp_10.42.42.5(pid=6566) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6566)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 16:37:59.780384 tst ping.py:22: Test FAILED (6.4 sec) 16:37:59.807025 run osmo-hlr_10.42.42.2(pid=6563): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6563)] 16:37:59.854454 run osmo-hlr_10.42.42.2(pid=6563): stdout: | (launched: 2022-12-13_16:37:56.643426) 16:37:59.903575 run osmo-hlr_10.42.42.2(pid=6563): stderr: | [0;m[1;31m20221213163756817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163756817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163756817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163756817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163756817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163756817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163756830 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163756838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163756839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163756839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:59.953168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6562): Terminating (SIGTERM) 16:37:59.993127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6565): Terminating (SIGTERM) 16:38:00.033017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6568): Terminating (SIGTERM) 16:38:00.073063 --- ParallelTerminationStrategy: PID 6562 died... 16:38:00.092318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6562): Terminated: ok {rc=0} 16:38:00.136086 --- ParallelTerminationStrategy: PID 6565 died... 16:38:00.154800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6565): Terminated: ok {rc=0} 16:38:00.198432 --- ParallelTerminationStrategy: PID 6568 died... 16:38:00.217072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6568): Terminated: ok {rc=0} 16:38:00.299871 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:38:01.389689 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:38:01.405574 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:38:01.490071 tst ping_idle_ping.py: using LAC 34888 16:38:01.619506 tst ping_idle_ping.py: using RAC 208 16:38:01.747886 tst ping_idle_ping.py: using CellId 34888 16:38:01.886260 tst ping_idle_ping.py: using BVCI 34889 16:38:02.005794 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:38:02.018260 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:38:02.030529 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:38:02.042811 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:38:02.055900 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:38:02.069118 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:38:02.082505 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:38:02.095492 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:38:02.220408 tst ping_idle_ping.py:24: start network... 16:38:02.422428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:02.889754 run create_hlr_db(pid=6570): Launched 16:38:03.014009 bus /gobi_6: Setting Powered False 16:38:04.075366 run create_hlr_db(pid=6570): Terminated: ok {rc=0} 16:38:04.516081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6572): Launched 16:38:04.839930 run osmo-hlr_10.42.42.2(pid=6573): Launched 16:38:04.963322 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:05.522608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6575): Launched 16:38:05.843757 run osmo-stp_10.42.42.5(pid=6576): Launched 16:38:05.966649 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:38:06.521927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6578): Launched 16:38:06.645435 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:38:06.916156 run patchelf(pid=6579): Launched 16:38:07.095183 run osmo-stp_10.42.42.5(pid=6576): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6576)] 16:38:07.231599 run osmo-stp_10.42.42.5(pid=6576): stdout: | (launched: 2022-12-13_16:38:05.785143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:07.369989 run osmo-stp_10.42.42.5(pid=6576): stderr: | [0;m[38;5;43m20221213163805974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163805974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163805974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163805974 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163805975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163805975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163805975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:07.508366 run osmo-stp_10.42.42.5(pid=6576): stdout: | (launched: 2022-12-13_16:38:05.785143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:07.639895 run osmo-stp_10.42.42.5(pid=6576): stderr: | [0;m[38;5;43m20221213163805974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163805974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163805974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163805974 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163805975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163805975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163805975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:07.795773 run patchelf(pid=6579): Terminating (SIGINT) 16:38:07.976269 run patchelf(pid=6579): Terminated: ok {rc=0} 16:38:08.106369 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6576): Process ended prematurely: osmo-stp_10.42.42.5(pid=6576) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6576)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:38:08.115950 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:38:08.144109 run osmo-hlr_10.42.42.2(pid=6573): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6573)] 16:38:08.194557 run osmo-hlr_10.42.42.2(pid=6573): stdout: | (launched: 2022-12-13_16:38:04.781142) 16:38:08.247299 run osmo-hlr_10.42.42.2(pid=6573): stderr: | [0;m[1;31m20221213163804977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163804977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163804977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163804977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163804977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163804977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163804991 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163805001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163805001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163805001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:08.299861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6572): Terminating (SIGTERM) 16:38:08.341721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6575): Terminating (SIGTERM) 16:38:08.383814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6578): Terminating (SIGTERM) 16:38:08.426347 --- ParallelTerminationStrategy: PID 6572 died... 16:38:08.447158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6572): Terminated: ok {rc=0} 16:38:08.493488 --- ParallelTerminationStrategy: PID 6575 died... 16:38:08.513417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6575): Terminated: ok {rc=0} 16:38:08.559409 --- ParallelTerminationStrategy: PID 6578 died... 16:38:08.579382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6578): Terminated: ok {rc=0} 16:38:08.667419 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:38:09.971276 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:38:09.977635 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:38:10.007062 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:38:10.046243 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:38:10.133721 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:38:10.162764 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:38:10.201313 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:38:10.799202 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:38:10.848183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:10.859371 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:38:10.925911 tst cs_paging_gprs_active.py: using LAC 34889 16:38:11.047675 tst cs_paging_gprs_active.py: using RAC 209 16:38:11.169297 tst cs_paging_gprs_active.py: using CellId 34889 16:38:11.289903 tst cs_paging_gprs_active.py: using BVCI 34890 16:38:11.410423 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:11.422463 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:11.434252 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:11.446323 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:11.458821 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:11.470992 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:11.483301 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:11.495236 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:11.507330 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:38:11.628736 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:38:11.752905 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:38:11.974584 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:12.302526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6584): Launched 16:38:12.589400 run iperf3-srv_10.42.42.10(pid=6585): Launched 16:38:12.712475 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:38:12.933359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:13.263502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6586): Launched 16:38:13.551746 run iperf3-srv_10.42.42.10(pid=6587): Launched 16:38:13.675297 tst cs_paging_gprs_active.py:38: start network... 16:38:13.896480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:14.403917 run create_hlr_db(pid=6588): Launched 16:38:14.529347 bus /gobi_6: Setting Powered False 16:38:15.593648 run create_hlr_db(pid=6588): Terminated: ok {rc=0} 16:38:16.052154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6590): Launched 16:38:16.384746 run osmo-hlr_10.42.42.2(pid=6591): Launched 16:38:16.659239 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:17.261325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6593): Launched 16:38:17.601962 run osmo-stp_10.42.42.5(pid=6594): Launched 16:38:17.728561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:38:18.295311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6596): Launched 16:38:18.423371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:38:18.709842 run patchelf(pid=6597): Launched 16:38:18.895977 run osmo-stp_10.42.42.5(pid=6594): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6594)] 16:38:19.035820 run osmo-stp_10.42.42.5(pid=6594): stdout: | (launched: 2022-12-13_16:38:17.541793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:19.177537 run osmo-stp_10.42.42.5(pid=6594): stderr: | [0;m[38;5;43m20221213163817731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163817731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163817731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163817732 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163817732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163817732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163817732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:19.319294 run osmo-stp_10.42.42.5(pid=6594): stdout: | (launched: 2022-12-13_16:38:17.541793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:19.454807 run osmo-stp_10.42.42.5(pid=6594): stderr: | [0;m[38;5;43m20221213163817731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163817731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163817731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163817732 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163817732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163817732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163817732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:19.615320 run patchelf(pid=6597): Terminating (SIGINT) 16:38:19.800417 run patchelf(pid=6597): Terminated: ok {rc=0} 16:38:19.933776 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6594): Process ended prematurely: osmo-stp_10.42.42.5(pid=6594) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6594)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:38:19.944245 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 16:38:19.973727 run osmo-hlr_10.42.42.2(pid=6591): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6591)] 16:38:20.024914 run osmo-hlr_10.42.42.2(pid=6591): stdout: | (launched: 2022-12-13_16:38:16.322724) 16:38:20.077673 run osmo-hlr_10.42.42.2(pid=6591): stderr: | [0;m[1;31m20221213163816537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163816537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163816537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163816537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163816537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163816537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163816554 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163816578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163816578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163816578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:20.130725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6584): Terminating (SIGTERM) 16:38:20.173456 run iperf3-srv_10.42.42.10(pid=6585): Terminating (SIGTERM) 16:38:20.216524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6586): Terminating (SIGTERM) 16:38:20.259418 run iperf3-srv_10.42.42.10(pid=6587): Terminating (SIGTERM) 16:38:20.302192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6590): Terminating (SIGTERM) 16:38:20.345175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6593): Terminating (SIGTERM) 16:38:20.388190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6596): Terminating (SIGTERM) 16:38:20.431000 --- ParallelTerminationStrategy: PID 6584 died... 16:38:20.452092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6584): Terminated: ok {rc=0} 16:38:20.499067 --- ParallelTerminationStrategy: PID 6585 died... 16:38:20.519184 run iperf3-srv_10.42.42.10(pid=6585): Terminated {rc=256} 16:38:20.565963 --- ParallelTerminationStrategy: PID 6586 died... 16:38:20.586216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6586): Terminated: ok {rc=0} 16:38:20.632621 --- ParallelTerminationStrategy: PID 6587 died... 16:38:20.652873 run iperf3-srv_10.42.42.10(pid=6587): Terminated {rc=256} 16:38:20.699361 --- ParallelTerminationStrategy: PID 6590 died... 16:38:20.719504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6590): Terminated: ok {rc=0} 16:38:20.765891 --- ParallelTerminationStrategy: PID 6593 died... 16:38:20.785978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6593): Terminated: ok {rc=0} 16:38:20.832582 --- ParallelTerminationStrategy: PID 6596 died... 16:38:20.852645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6596): Terminated: ok {rc=0} 16:38:20.941066 bus /gobi_0: Setting Powered False 16:38:22.040596 bus /gobi_0: Setting Powered False 16:38:23.157493 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:38:24.309267 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:24.321644 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:38:24.397428 tst iperf3.py: using LAC 34890 16:38:24.526091 tst iperf3.py: using RAC 210 16:38:24.654368 tst iperf3.py: using CellId 34890 16:38:24.782910 tst iperf3.py: using BVCI 34891 16:38:24.902899 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:24.914673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:24.926195 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:24.937682 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:24.949760 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:24.961561 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:24.973476 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:24.985191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:24.997091 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:38:25.114928 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:38:25.320802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:25.629532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6598): Launched 16:38:25.896552 run iperf3-srv_10.42.42.10(pid=6599): Launched 16:38:26.012124 tst iperf3.py:8: start network... 16:38:26.217211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:26.692623 run create_hlr_db(pid=6600): Launched 16:38:26.819832 bus /gobi_6: Setting Powered False 16:38:27.879877 run create_hlr_db(pid=6600): Terminated: ok {rc=0} 16:38:28.328055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6602): Launched 16:38:28.658094 run osmo-hlr_10.42.42.2(pid=6603): Launched 16:38:28.783729 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:29.351404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6605): Launched 16:38:29.682061 run osmo-stp_10.42.42.5(pid=6606): Launched 16:38:29.808462 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:38:30.373727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6608): Launched 16:38:30.500873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:38:30.778622 run patchelf(pid=6609): Launched 16:38:30.972242 run osmo-stp_10.42.42.5(pid=6606): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6606)] 16:38:31.114307 run osmo-stp_10.42.42.5(pid=6606): stdout: | (launched: 2022-12-13_16:38:29.622075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:31.258583 run osmo-stp_10.42.42.5(pid=6606): stderr: | [0;m[38;5;43m20221213163829814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163829814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163829814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163829815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163829815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163829815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163829815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:31.403299 run osmo-stp_10.42.42.5(pid=6606): stdout: | (launched: 2022-12-13_16:38:29.622075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:31.541735 run osmo-stp_10.42.42.5(pid=6606): stderr: | [0;m[38;5;43m20221213163829814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163829814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163829814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163829815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163829815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163829815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163829815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:31.700696 run patchelf(pid=6609): Terminating (SIGINT) 16:38:31.883293 run patchelf(pid=6609): Terminated: ok {rc=0} 16:38:32.014749 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6606): Process ended prematurely: osmo-stp_10.42.42.5(pid=6606) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6606)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 16:38:32.025252 tst iperf3.py:8: Test FAILED (7.8 sec) 16:38:32.053850 run osmo-hlr_10.42.42.2(pid=6603): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6603)] 16:38:32.103279 run osmo-hlr_10.42.42.2(pid=6603): stdout: | (launched: 2022-12-13_16:38:28.598420) 16:38:32.155086 run osmo-hlr_10.42.42.2(pid=6603): stderr: | [0;m[1;31m20221213163828794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163828794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163828794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163828794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163828794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163828794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163828807 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163828817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163828817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163828817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:32.206418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6598): Terminating (SIGTERM) 16:38:32.246715 run iperf3-srv_10.42.42.10(pid=6599): Terminating (SIGTERM) 16:38:32.287277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6602): Terminating (SIGTERM) 16:38:32.327679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6605): Terminating (SIGTERM) 16:38:32.367928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6608): Terminating (SIGTERM) 16:38:32.408322 --- ParallelTerminationStrategy: PID 6598 died... 16:38:32.427473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6598): Terminated: ok {rc=0} 16:38:32.471257 --- ParallelTerminationStrategy: PID 6599 died... 16:38:32.490135 run iperf3-srv_10.42.42.10(pid=6599): Terminated {rc=256} 16:38:32.534117 --- ParallelTerminationStrategy: PID 6602 died... 16:38:32.552834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6602): Terminated: ok {rc=0} 16:38:32.597117 --- ParallelTerminationStrategy: PID 6605 died... 16:38:32.615762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6605): Terminated: ok {rc=0} 16:38:32.659573 --- ParallelTerminationStrategy: PID 6608 died... 16:38:32.678370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6608): Terminated: ok {rc=0} 16:38:32.764554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:38:33.912645 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:33.924690 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:38:33.992119 tst iperf3m4.py: using LAC 34891 16:38:34.114085 tst iperf3m4.py: using RAC 211 16:38:34.235302 tst iperf3m4.py: using CellId 34891 16:38:34.356651 tst iperf3m4.py: using BVCI 34892 16:38:34.468727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:34.480069 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:34.491122 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:34.502167 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:34.513145 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:34.524127 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:34.535402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:34.546337 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:34.557975 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:38:34.675989 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:38:34.800204 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:38:34.918717 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:38:35.035978 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:38:35.243318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:35.553781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6610): Launched 16:38:35.822787 run iperf3-srv_10.42.42.10(pid=6611): Launched 16:38:35.938685 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:38:36.144167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:36.454307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6612): Launched 16:38:36.723282 run iperf3-srv_10.42.42.10(pid=6613): Launched 16:38:36.839306 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:38:37.044558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:37.354714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6614): Launched 16:38:37.624298 run iperf3-srv_10.42.42.10(pid=6615): Launched 16:38:37.739769 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:38:37.944540 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:38.253120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6616): Launched 16:38:38.521891 run iperf3-srv_10.42.42.10(pid=6617): Launched 16:38:38.637792 tst iperf3m4.py:8: start network... 16:38:38.842726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:39.318845 run create_hlr_db(pid=6618): Launched 16:38:39.446766 bus /gobi_6: Setting Powered False 16:38:40.507984 run create_hlr_db(pid=6618): Terminated: ok {rc=0} 16:38:40.956556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6620): Launched 16:38:41.287144 run osmo-hlr_10.42.42.2(pid=6621): Launched 16:38:41.415938 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:41.983876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6623): Launched 16:38:42.315259 run osmo-stp_10.42.42.5(pid=6624): Launched 16:38:42.443139 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:38:43.011939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6626): Launched 16:38:43.140148 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:38:43.420068 run patchelf(pid=6627): Launched 16:38:43.605772 run osmo-stp_10.42.42.5(pid=6624): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6624)] 16:38:43.745836 run osmo-stp_10.42.42.5(pid=6624): stdout: | (launched: 2022-12-13_16:38:42.255166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:43.888159 run osmo-stp_10.42.42.5(pid=6624): stderr: | [0;m[38;5;43m20221213163842443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163842443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163842443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163842444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163842444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163842444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163842444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:44.030247 run osmo-stp_10.42.42.5(pid=6624): stdout: | (launched: 2022-12-13_16:38:42.255166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:44.165431 run osmo-stp_10.42.42.5(pid=6624): stderr: | [0;m[38;5;43m20221213163842443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163842443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163842443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163842444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163842444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163842444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163842444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:44.325622 run patchelf(pid=6627): Terminating (SIGINT) 16:38:44.512175 run patchelf(pid=6627): Terminated: ok {rc=0} 16:38:44.646446 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6624): Process ended prematurely: osmo-stp_10.42.42.5(pid=6624) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6624)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:38:44.656857 tst iperf3m4.py:8: Test FAILED (10.8 sec) 16:38:44.686238 run osmo-hlr_10.42.42.2(pid=6621): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6621)] 16:38:44.737362 run osmo-hlr_10.42.42.2(pid=6621): stdout: | (launched: 2022-12-13_16:38:41.226612) 16:38:44.790272 run osmo-hlr_10.42.42.2(pid=6621): stderr: | [0;m[1;31m20221213163841422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163841422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163841422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163841422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163841422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163841422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163841460 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163841470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163841470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163841470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:44.842849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6610): Terminating (SIGTERM) 16:38:44.885523 run iperf3-srv_10.42.42.10(pid=6611): Terminating (SIGTERM) 16:38:44.928470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6612): Terminating (SIGTERM) 16:38:44.970990 run iperf3-srv_10.42.42.10(pid=6613): Terminating (SIGTERM) 16:38:45.013899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6614): Terminating (SIGTERM) 16:38:45.056312 run iperf3-srv_10.42.42.10(pid=6615): Terminating (SIGTERM) 16:38:45.098652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6616): Terminating (SIGTERM) 16:38:45.141105 run iperf3-srv_10.42.42.10(pid=6617): Terminating (SIGTERM) 16:38:45.183307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6620): Terminating (SIGTERM) 16:38:45.226428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6623): Terminating (SIGTERM) 16:38:45.268802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6626): Terminating (SIGTERM) 16:38:45.311589 --- ParallelTerminationStrategy: PID 6610 died... 16:38:45.332253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6610): Terminated: ok {rc=0} 16:38:45.379523 --- ParallelTerminationStrategy: PID 6611 died... 16:38:45.399562 run iperf3-srv_10.42.42.10(pid=6611): Terminated {rc=256} 16:38:45.446363 --- ParallelTerminationStrategy: PID 6612 died... 16:38:45.466844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6612): Terminated: ok {rc=0} 16:38:45.513740 --- ParallelTerminationStrategy: PID 6613 died... 16:38:45.533878 run iperf3-srv_10.42.42.10(pid=6613): Terminated {rc=256} 16:38:45.580790 --- ParallelTerminationStrategy: PID 6614 died... 16:38:45.601451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6614): Terminated: ok {rc=0} 16:38:45.648376 --- ParallelTerminationStrategy: PID 6615 died... 16:38:45.668377 run iperf3-srv_10.42.42.10(pid=6615): Terminated {rc=256} 16:38:45.715393 --- ParallelTerminationStrategy: PID 6616 died... 16:38:45.735517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6616): Terminated: ok {rc=0} 16:38:45.782332 --- ParallelTerminationStrategy: PID 6617 died... 16:38:45.802391 run iperf3-srv_10.42.42.10(pid=6617): Terminated {rc=256} 16:38:45.866306 --- ParallelTerminationStrategy: PID 6620 died... 16:38:45.886391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6620): Terminated: ok {rc=0} 16:38:45.933299 --- ParallelTerminationStrategy: PID 6623 died... 16:38:45.955492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6623): Terminated: ok {rc=0} 16:38:46.001958 --- ParallelTerminationStrategy: PID 6626 died... 16:38:46.022937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6626): Terminated: ok {rc=0} 16:38:46.111721 bus /gobi_4: Setting Powered False 16:38:47.219360 bus /gobi_4: Setting Powered False 16:38:48.375097 bus /gobi_1: Setting Powered False 16:38:49.487994 bus /gobi_1: Setting Powered False 16:38:50.608247 bus /gobi_0: Setting Powered False 16:38:51.713956 bus /gobi_0: Setting Powered False 16:38:52.837136 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:38:53.948128 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:53.961878 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:38:54.037302 tst ping.py: using LAC 34892 16:38:54.168406 tst ping.py: using RAC 212 16:38:54.298800 tst ping.py: using CellId 34892 16:38:54.430327 tst ping.py: using BVCI 34893 16:38:54.555420 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:54.568798 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:54.582038 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:54.594638 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:54.608119 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:54.622426 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:54.635973 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:38:54.649235 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:38:54.779510 tst ping.py:19: start network... 16:38:55.006564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:55.522084 run create_hlr_db(pid=6900): Launched 16:38:55.691269 bus /gobi_6: Setting Powered False 16:38:56.758554 run create_hlr_db(pid=6900): Terminated: ok {rc=0} 16:38:57.226569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6902): Launched 16:38:57.575028 run osmo-hlr_10.42.42.2(pid=6903): Launched 16:38:57.830063 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:58.501806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6905): Launched 16:38:58.849212 run osmo-stp_10.42.42.5(pid=6906): Launched 16:38:59.098402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:38:59.758036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6908): Launched 16:38:59.897458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:39:00.182704 run patchelf(pid=6909): Launched 16:39:00.384340 run osmo-stp_10.42.42.5(pid=6906): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6906)] 16:39:00.528497 run osmo-stp_10.42.42.5(pid=6906): stdout: | (launched: 2022-12-13_16:38:58.789178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:00.677256 run osmo-stp_10.42.42.5(pid=6906): stderr: | [0;m[38;5;43m20221213163859080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163859080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163859080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163859085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163859086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163859086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163859086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:00.823607 run osmo-stp_10.42.42.5(pid=6906): stdout: | (launched: 2022-12-13_16:38:58.789178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:00.996888 run osmo-stp_10.42.42.5(pid=6906): stderr: | [0;m[38;5;43m20221213163859080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163859080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163859080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163859085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163859086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163859086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163859086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:01.163530 run patchelf(pid=6909): Terminating (SIGINT) 16:39:01.353834 run patchelf(pid=6909): Terminated: ok {rc=0} 16:39:01.492042 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6906): Process ended prematurely: osmo-stp_10.42.42.5(pid=6906) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6906)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 16:39:01.503057 tst ping.py:22: Test FAILED (7.5 sec) 16:39:01.533530 run osmo-hlr_10.42.42.2(pid=6903): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6903)] 16:39:01.589917 run osmo-hlr_10.42.42.2(pid=6903): stdout: | (launched: 2022-12-13_16:38:57.512842) 16:39:01.644489 run osmo-hlr_10.42.42.2(pid=6903): stderr: | [0;m[1;31m20221213163857823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163857823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163857823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163857823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163857823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163857823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163857843 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163857851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163857852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163857852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:01.702358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6902): Terminating (SIGTERM) 16:39:01.748010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6905): Terminating (SIGTERM) 16:39:01.795750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6908): Terminating (SIGTERM) 16:39:01.842787 --- ParallelTerminationStrategy: PID 6902 died... 16:39:01.865320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6902): Terminated: ok {rc=0} 16:39:01.917063 --- ParallelTerminationStrategy: PID 6905 died... 16:39:01.938380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6905): Terminated: ok {rc=0} 16:39:01.988373 --- ParallelTerminationStrategy: PID 6908 died... 16:39:02.010377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6908): Terminated: ok {rc=0} 16:39:02.118846 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:39:03.236650 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:39:03.249820 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:39:03.319164 tst ping_idle_ping.py: using LAC 34893 16:39:03.443640 tst ping_idle_ping.py: using RAC 213 16:39:03.569484 tst ping_idle_ping.py: using CellId 34893 16:39:03.694401 tst ping_idle_ping.py: using BVCI 34894 16:39:03.810733 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:39:03.823887 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:39:03.836108 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:39:03.848389 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:39:03.860685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:39:03.873331 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:39:03.886230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:39:03.898744 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:39:04.021446 tst ping_idle_ping.py:24: start network... 16:39:04.234760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:04.727093 run create_hlr_db(pid=6910): Launched 16:39:04.894166 bus /gobi_6: Setting Powered False 16:39:05.958555 run create_hlr_db(pid=6910): Terminated: ok {rc=0} 16:39:06.407129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6912): Launched 16:39:06.741708 run osmo-hlr_10.42.42.2(pid=6913): Launched 16:39:06.982307 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:07.697623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6915): Launched 16:39:08.030447 run osmo-stp_10.42.42.5(pid=6916): Launched 16:39:08.273968 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:39:08.970519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6919): Launched 16:39:09.096440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:39:09.373213 run patchelf(pid=6920): Launched 16:39:09.556326 run osmo-stp_10.42.42.5(pid=6916): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6916)] 16:39:09.694567 run osmo-stp_10.42.42.5(pid=6916): stdout: | (launched: 2022-12-13_16:39:07.971398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:09.835288 run osmo-stp_10.42.42.5(pid=6916): stderr: | [0;m[38;5;43m20221213163908296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163908297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163908297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163908297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163908298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163908298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163908298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:09.975798 run osmo-stp_10.42.42.5(pid=6916): stdout: | (launched: 2022-12-13_16:39:07.971398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:10.109310 run osmo-stp_10.42.42.5(pid=6916): stderr: | [0;m[38;5;43m20221213163908296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163908297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163908297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163908297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163908298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163908298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163908298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:10.267816 run patchelf(pid=6920): Terminating (SIGINT) 16:39:10.451150 run patchelf(pid=6920): Terminated: ok {rc=0} 16:39:10.583592 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6916): Process ended prematurely: osmo-stp_10.42.42.5(pid=6916) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6916)] [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:39:10.593393 tst ping_idle_ping.py:27: Test FAILED (7.3 sec) 16:39:10.621990 run osmo-hlr_10.42.42.2(pid=6913): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6913)] 16:39:10.673233 run osmo-hlr_10.42.42.2(pid=6913): stdout: | (launched: 2022-12-13_16:39:06.682582) 16:39:10.726311 run osmo-hlr_10.42.42.2(pid=6913): stderr: | [0;m[1;31m20221213163907021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163907021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163907021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163907021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163907021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163907021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163907037 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163907049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163907050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163907050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:10.779394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6912): Terminating (SIGTERM) 16:39:10.821929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6915): Terminating (SIGTERM) 16:39:10.864755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6919): Terminating (SIGTERM) 16:39:10.907865 --- ParallelTerminationStrategy: PID 6912 died... 16:39:10.928630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6912): Terminated: ok {rc=0} 16:39:10.975775 --- ParallelTerminationStrategy: PID 6915 died... 16:39:10.995967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6915): Terminated: ok {rc=0} 16:39:11.042877 --- ParallelTerminationStrategy: PID 6919 died... 16:39:11.063079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6919): Terminated: ok {rc=0} 16:39:11.152361 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:39:12.452194 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:12.460473 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:39:12.490931 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:39:12.527407 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:39:12.582519 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:39:12.612743 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:39:12.648819 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:39:13.211630 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:39:13.218275 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:39:13.230399 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:39:13.298506 tst switch_tch_pdch.py: using LAC 34894 16:39:13.424292 tst switch_tch_pdch.py: using RAC 214 16:39:13.553409 tst switch_tch_pdch.py: using CellId 34894 16:39:13.680283 tst switch_tch_pdch.py: using BVCI 34895 16:39:13.798732 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:39:13.810702 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:39:13.822596 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:39:13.834529 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:39:13.846773 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:39:13.858931 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:39:13.871206 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:39:13.883332 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:39:14.001364 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:39:14.122914 tst switch_tch_pdch.py:51: start network... 16:39:14.326415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:14.798648 run create_hlr_db(pid=6926): Launched 16:39:14.925570 bus /gobi_6: Setting Powered False 16:39:15.988284 run create_hlr_db(pid=6926): Terminated: ok {rc=0} 16:39:16.460423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6928): Launched 16:39:16.805785 run osmo-hlr_10.42.42.2(pid=6929): Launched 16:39:16.986324 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:17.682318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6931): Launched 16:39:18.011496 run osmo-stp_10.42.42.5(pid=6932): Launched 16:39:18.137552 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:39:18.702041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6934): Launched 16:39:18.828632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:39:19.104040 run patchelf(pid=6935): Launched 16:39:19.287669 run osmo-stp_10.42.42.5(pid=6932): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6932)] 16:39:19.425809 run osmo-stp_10.42.42.5(pid=6932): stdout: | (launched: 2022-12-13_16:39:17.951031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:19.566859 run osmo-stp_10.42.42.5(pid=6932): stderr: | [0;m[38;5;43m20221213163918141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163918141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163918141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163918141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163918142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163918142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163918142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:19.707884 run osmo-stp_10.42.42.5(pid=6932): stdout: | (launched: 2022-12-13_16:39:17.951031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:19.841934 run osmo-stp_10.42.42.5(pid=6932): stderr: | [0;m[38;5;43m20221213163918141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163918141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163918141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163918141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163918142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163918142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163918142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:20.000035 run patchelf(pid=6935): Terminating (SIGINT) 16:39:20.183399 run patchelf(pid=6935): Terminated: ok {rc=0} 16:39:20.314802 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6932): Process ended prematurely: osmo-stp_10.42.42.5(pid=6932) [trial-2391↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6932)] [trial-2391↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:39:20.324556 tst switch_tch_pdch.py:54: Test FAILED (7.1 sec) 16:39:20.353217 run osmo-hlr_10.42.42.2(pid=6929): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6929)] 16:39:20.404429 run osmo-hlr_10.42.42.2(pid=6929): stdout: | (launched: 2022-12-13_16:39:16.742564) 16:39:20.457638 run osmo-hlr_10.42.42.2(pid=6929): stderr: | [0;m[1;31m20221213163917090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163917090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163917090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163917090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163917090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163917090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163917107 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163917115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163917116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163917116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:20.511230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6928): Terminating (SIGTERM) 16:39:20.553906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6931): Terminating (SIGTERM) 16:39:20.596758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6934): Terminating (SIGTERM) 16:39:20.639840 --- ParallelTerminationStrategy: PID 6928 died... 16:39:20.660798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6928): Terminated: ok {rc=0} 16:39:20.707993 --- ParallelTerminationStrategy: PID 6931 died... 16:39:20.728157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6931): Terminated: ok {rc=0} 16:39:20.775338 --- ParallelTerminationStrategy: PID 6934 died... 16:39:20.795623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6934): Terminated: ok {rc=0} 16:39:20.885830 bus /gobi_0: Setting Powered False 16:39:21.984875 bus /gobi_0: Setting Powered False 16:39:23.104621 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:39:24.365366 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:24.371514 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:39:24.401711 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:39:24.437960 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:39:24.496189 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:39:24.528227 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:39:24.564026 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:39:25.118005 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:39:25.123606 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:39:25.135432 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:39:25.202077 tst switch_tch_pdch.py: using LAC 34895 16:39:25.326966 tst switch_tch_pdch.py: using RAC 215 16:39:25.451714 tst switch_tch_pdch.py: using CellId 34895 16:39:25.576435 tst switch_tch_pdch.py: using BVCI 34896 16:39:25.694084 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:39:25.706009 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:39:25.717746 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:39:25.729539 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:39:25.741524 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:39:25.753406 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:39:25.765551 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:39:25.777593 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:39:25.896622 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:39:26.019607 tst switch_tch_pdch.py:51: start network... 16:39:26.239565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:26.714721 run create_hlr_db(pid=6939): Launched 16:39:26.839333 bus /gobi_6: Setting Powered False 16:39:27.903440 run create_hlr_db(pid=6939): Terminated: ok {rc=0} 16:39:28.314198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6941): Launched 16:39:28.620739 run osmo-hlr_10.42.42.2(pid=6942): Launched 16:39:28.739126 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:29.253363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6944): Launched 16:39:29.559709 run osmo-stp_10.42.42.5(pid=6945): Launched 16:39:29.678358 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:39:30.180077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6947): Launched 16:39:30.297634 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:39:30.556003 run patchelf(pid=6948): Launched 16:39:30.726245 run osmo-stp_10.42.42.5(pid=6945): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6945)] 16:39:30.856901 run osmo-stp_10.42.42.5(pid=6945): stdout: | (launched: 2022-12-13_16:39:29.502851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:30.996462 run osmo-stp_10.42.42.5(pid=6945): stderr: | [0;m[38;5;43m20221213163929674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163929674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163929674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163929675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163929675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163929675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163929675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:31.131359 run osmo-stp_10.42.42.5(pid=6945): stdout: | (launched: 2022-12-13_16:39:29.502851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:31.258658 run osmo-stp_10.42.42.5(pid=6945): stderr: | [0;m[38;5;43m20221213163929674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163929674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163929674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163929675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163929675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163929675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163929675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:31.411683 run patchelf(pid=6948): Terminating (SIGINT) 16:39:31.587559 run patchelf(pid=6948): Terminated: ok {rc=0} 16:39:31.714389 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6945): Process ended prematurely: osmo-stp_10.42.42.5(pid=6945) [trial-2391↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6945)] [trial-2391↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:39:31.724594 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 16:39:31.753161 run osmo-hlr_10.42.42.2(pid=6942): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6942)] 16:39:31.802432 run osmo-hlr_10.42.42.2(pid=6942): stdout: | (launched: 2022-12-13_16:39:28.563897) 16:39:31.853362 run osmo-hlr_10.42.42.2(pid=6942): stderr: | [0;m[1;31m20221213163928738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163928738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163928738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163928738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163928738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163928738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163928751 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163928759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163928760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163928760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:31.905385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6941): Terminating (SIGTERM) 16:39:31.946308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6944): Terminating (SIGTERM) 16:39:31.988987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6947): Terminating (SIGTERM) 16:39:32.033059 --- ParallelTerminationStrategy: PID 6941 died... 16:39:32.053193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6941): Terminated: ok {rc=0} 16:39:32.100077 --- ParallelTerminationStrategy: PID 6944 died... 16:39:32.119268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6944): Terminated: ok {rc=0} 16:39:32.163907 --- ParallelTerminationStrategy: PID 6947 died... 16:39:32.182920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6947): Terminated: ok {rc=0} 16:39:32.268118 bus /gobi_0: Setting Powered False 16:39:33.367263 bus /gobi_0: Setting Powered False 16:39:34.486227 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_sms:nanobts --------------------------------------------------------------------- 16:39:35.736805 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:35.740541 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 16:39:35.764442 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 16:39:35.771152 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 16:39:35.822872 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 16:39:35.846642 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 16:39:35.853348 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 16:39:36.390879 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 16:39:36.396196 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 16:39:36.407243 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 16:39:36.445392 tst mo_mt_sms.py: using LAC 34896 16:39:36.574085 tst mo_mt_sms.py: using RAC 216 16:39:36.702672 tst mo_mt_sms.py: using CellId 34896 16:39:36.829162 tst mo_mt_sms.py: using BVCI 34897 16:39:36.947984 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 16:39:37.065596 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 16:39:37.180203 tst mo_mt_sms.py:9: start nitb and bts... 16:39:37.384197 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:39:38.008070 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6952): Launched 16:39:38.314820 run osmo-nitb_10.42.42.2(pid=6953): Launched 16:39:38.487117 run osmo-nitb_10.42.42.2(pid=6953): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6953)] 16:39:38.624593 run osmo-nitb_10.42.42.2(pid=6953): stdout: | (launched: 2022-12-13_16:39:38.257938) 16:39:38.763372 run osmo-nitb_10.42.42.2(pid=6953): stderr: | (launched: 2022-12-13_16:39:38.303244) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:39:38.902272 run osmo-nitb_10.42.42.2(pid=6953): stdout: | (launched: 2022-12-13_16:39:38.257938) 16:39:39.035210 run osmo-nitb_10.42.42.2(pid=6953): stderr: | (launched: 2022-12-13_16:39:38.303244) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6953): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6953) [trial-2391↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6953)] 16:39:39.432513 tst osmo-nitb_10.42.42.2(pid=6953): stdout: | (launched: 2022-12-13_16:39:38.257938) 16:39:39.555685 tst osmo-nitb_10.42.42.2(pid=6953): stderr: | (launched: 2022-12-13_16:39:38.303244) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:39:39.700278 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6953): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6953) [trial-2391↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6953)] [trial-2391↪nitb_sms:nanobts↪mo_mt_sms.py:11] 16:39:39.708739 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 16:39:39.715342 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6952): Terminating (SIGTERM) 16:39:39.924339 --- ParallelTerminationStrategy: PID 6952 died... 16:39:39.945459 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6952): Terminated: ok {rc=0} 16:39:40.034465 bus /sierra_3: Setting Powered False 16:39:41.135502 bus /sierra_3: Setting Powered False 16:39:42.252264 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 sms:nanobts+band-1900 --------------------------------------------------------------------- 16:39:43.437617 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:43.442610 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:39:43.466315 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 16:39:43.493089 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 16:39:43.544694 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:39:43.568747 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 16:39:43.595524 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 16:39:44.143703 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 16:39:44.148904 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:44.159935 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:39:44.197884 tst mo_mt_sms.py: using LAC 34897 16:39:44.326338 tst mo_mt_sms.py: using RAC 217 16:39:44.455076 tst mo_mt_sms.py: using CellId 34897 16:39:44.584252 tst mo_mt_sms.py: using BVCI 34898 16:39:44.703791 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:44.715140 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:44.726375 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:44.737526 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:44.749029 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:44.760441 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 16:39:44.877232 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 16:39:44.997680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:45.510556 run create_hlr_db(pid=6957): Launched 16:39:45.636056 bus /sierra_2: Setting Powered False 16:39:46.698930 run create_hlr_db(pid=6957): Terminated: ok {rc=0} 16:39:47.141157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6959): Launched 16:39:47.461987 run osmo-hlr_10.42.42.2(pid=6960): Launched 16:39:47.580102 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:48.120491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6962): Launched 16:39:48.426282 run osmo-stp_10.42.42.5(pid=6963): Launched 16:39:48.544809 run osmo-msc_10.42.42.6: Starting osmo-msc 16:39:49.096746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6965): Launched 16:39:49.403439 run osmo-msc_10.42.42.6(pid=6966): Launched 16:39:49.574774 run osmo-stp_10.42.42.5(pid=6963): ERR: Terminated: ERROR {rc=1} [trial-2391↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6963)] 16:39:49.703766 run osmo-stp_10.42.42.5(pid=6963): stdout: | (launched: 2022-12-13_16:39:48.369416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:49.832577 run osmo-stp_10.42.42.5(pid=6963): stderr: | [0;m[38;5;43m20221213163948541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163948541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163948541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163948542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163948542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163948542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163948542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:49.959603 run osmo-stp_10.42.42.5(pid=6963): stdout: | (launched: 2022-12-13_16:39:48.369416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:50.081953 run osmo-stp_10.42.42.5(pid=6963): stderr: | [0;m[38;5;43m20221213163948541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213163948541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213163948541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213163948542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213163948542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213163948542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213163948542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:50.227615 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6963): Process ended prematurely: osmo-stp_10.42.42.5(pid=6963) [trial-2391↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6963)] [trial-2391↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 16:39:50.236117 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 16:39:50.262195 run osmo-hlr_10.42.42.2(pid=6960): ERR: Terminated: ERROR {rc=237} [trial-2391↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6960)] 16:39:50.310308 run osmo-hlr_10.42.42.2(pid=6960): stdout: | (launched: 2022-12-13_16:39:47.404735) 16:39:50.359551 run osmo-hlr_10.42.42.2(pid=6960): stderr: | [0;m[1;31m20221213163947583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213163947583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213163947583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213163947584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213163947584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213163947584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213163947598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213163947608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213163947608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213163947608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:50.428412 run osmo-msc_10.42.42.6(pid=6966): ERR: Terminated: ERROR {rc=2} [trial-2391↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6966)] 16:39:50.475810 run osmo-msc_10.42.42.6(pid=6966): stdout: | (launched: 2022-12-13_16:39:49.346243) 16:39:50.525040 run osmo-msc_10.42.42.6(pid=6966): stderr: | [0;m[38;5;43m20221213163949620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213163949620 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a75b95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213163949620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213163949620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213163949621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213163949621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213163949622 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213163949623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213163949623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213163949623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:39:50.574762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6959): Terminating (SIGTERM) 16:39:50.614445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6962): Terminating (SIGTERM) 16:39:50.654054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6965): Terminating (SIGTERM) 16:39:50.693911 --- ParallelTerminationStrategy: PID 6959 died... 16:39:50.713211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6959): Terminated: ok {rc=0} 16:39:50.757175 --- ParallelTerminationStrategy: PID 6962 died... 16:39:50.775865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6962): Terminated: ok {rc=0} 16:39:50.819715 --- ParallelTerminationStrategy: PID 6965 died... 16:39:50.838355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6965): Terminated: ok {rc=0} 16:39:50.925244 bus /sierra_3: Setting Powered False 16:39:52.027121 bus /sierra_3: Setting Powered False 16:39:53.144152 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 16:39:54.367138 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:54.371872 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:39:54.395552 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 16:39:54.402287 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 16:39:54.438419 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:39:54.462443 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 16:39:54.469126 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 16:39:54.988509 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2391 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 16:39:54.993880 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 16:39:55.004895 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:39:55.042923 tst assert_extension.py: using LAC 34898 16:39:55.161026 tst assert_extension.py: using RAC 218 16:39:55.283034 tst assert_extension.py: using CellId 34898 16:39:55.402110 tst assert_extension.py: using BVCI 34899 16:39:55.511564 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 16:39:55.628410 tst assert_extension.py:10: start nitb and bts... 16:39:55.832336 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:39:56.454854 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6971): Launched 16:39:56.763930 run osmo-nitb_10.42.42.2(pid=6972): Launched 16:39:56.934839 run osmo-nitb_10.42.42.2(pid=6972): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6972)] 16:39:57.072157 run osmo-nitb_10.42.42.2(pid=6972): stdout: | (launched: 2022-12-13_16:39:56.706930) 16:39:57.210844 run osmo-nitb_10.42.42.2(pid=6972): stderr: | (launched: 2022-12-13_16:39:56.752618) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:39:57.349618 run osmo-nitb_10.42.42.2(pid=6972): stdout: | (launched: 2022-12-13_16:39:56.706930) 16:39:57.482387 run osmo-nitb_10.42.42.2(pid=6972): stderr: | (launched: 2022-12-13_16:39:56.752618) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6972): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6972) [trial-2391↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6972)] 16:39:57.880269 tst osmo-nitb_10.42.42.2(pid=6972): stdout: | (launched: 2022-12-13_16:39:56.706930) 16:39:58.004327 tst osmo-nitb_10.42.42.2(pid=6972): stderr: | (launched: 2022-12-13_16:39:56.752618) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:39:58.150223 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6972): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6972) [trial-2391↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6972)] [trial-2391↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 16:39:58.158991 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:39:58.165723 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6971): Terminating (SIGTERM) 16:39:58.374564 --- ParallelTerminationStrategy: PID 6971 died... 16:39:58.395590 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6971): Terminated: ok {rc=0} 16:39:58.483287 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 ussd:nanobts+band-1900 --------------------------------------------------------------------- 16:39:59.656090 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:59.661755 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:39:59.686757 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 16:39:59.715393 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 16:39:59.753234 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:39:59.779361 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 16:39:59.807452 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 16:40:00.335164 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2391 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 16:40:00.340805 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:00.352394 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:40:00.392802 tst assert_extension.py: using LAC 34899 16:40:00.520938 tst assert_extension.py: using RAC 219 16:40:00.649724 tst assert_extension.py: using CellId 34899 16:40:00.769066 tst assert_extension.py: using BVCI 34900 16:40:00.885804 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:00.900127 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:00.911560 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:00.922739 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:00.933875 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:00.944833 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 16:40:01.081601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:01.566353 run create_hlr_db(pid=6976): Launched 16:40:01.734342 bus /sierra_2: Setting Powered False 16:40:02.795622 run create_hlr_db(pid=6976): Terminated: ok {rc=0} 16:40:03.242592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6981): Launched 16:40:03.570993 run osmo-hlr_10.42.42.2(pid=6982): Launched 16:40:03.689274 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:04.234951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6984): Launched 16:40:04.541568 run osmo-stp_10.42.42.5(pid=6985): Launched 16:40:04.658706 run osmo-msc_10.42.42.6: Starting osmo-msc 16:40:05.208606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6987): Launched 16:40:05.515898 run osmo-msc_10.42.42.6(pid=6988): Launched 16:40:05.687543 run osmo-stp_10.42.42.5(pid=6985): ERR: Terminated: ERROR {rc=1} [trial-2391↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6985)] 16:40:05.816220 run osmo-stp_10.42.42.5(pid=6985): stdout: | (launched: 2022-12-13_16:40:04.484520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:05.945229 run osmo-stp_10.42.42.5(pid=6985): stderr: | [0;m[38;5;43m20221213164004655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164004655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164004656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164004656 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164004657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164004657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164004657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:06.072060 run osmo-stp_10.42.42.5(pid=6985): stdout: | (launched: 2022-12-13_16:40:04.484520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:06.194598 run osmo-stp_10.42.42.5(pid=6985): stderr: | [0;m[38;5;43m20221213164004655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164004655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164004656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164004656 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164004657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164004657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164004657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:06.339813 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6985): Process ended prematurely: osmo-stp_10.42.42.5(pid=6985) [trial-2391↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6985)] [trial-2391↪ussd:nanobts+band-1900↪assert_extension.py:17] 16:40:06.348419 tst assert_extension.py:17: Test FAILED (6.0 sec) 16:40:06.374697 run osmo-hlr_10.42.42.2(pid=6982): ERR: Terminated: ERROR {rc=237} [trial-2391↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6982)] 16:40:06.423003 run osmo-hlr_10.42.42.2(pid=6982): stdout: | (launched: 2022-12-13_16:40:03.510628) 16:40:06.472579 run osmo-hlr_10.42.42.2(pid=6982): stderr: | [0;m[1;31m20221213164003695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164003696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164003696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164003696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164003696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164003696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164003708 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164003717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164003718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164003718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:06.541967 run osmo-msc_10.42.42.6(pid=6988): ERR: Terminated: ERROR {rc=2} [trial-2391↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6988)] 16:40:06.590455 run osmo-msc_10.42.42.6(pid=6988): stdout: | (launched: 2022-12-13_16:40:05.458978) 16:40:06.639971 run osmo-msc_10.42.42.6(pid=6988): stderr: | [0;m[38;5;43m20221213164005733 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164005733 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feaf7bbcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164005733 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164005733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164005733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164005734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164005735 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164005736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164005736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164005736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:40:06.689742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6981): Terminating (SIGTERM) 16:40:06.730437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6984): Terminating (SIGTERM) 16:40:06.770600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6987): Terminating (SIGTERM) 16:40:06.810951 --- ParallelTerminationStrategy: PID 6981 died... 16:40:06.830217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6981): Terminated: ok {rc=0} 16:40:06.874423 --- ParallelTerminationStrategy: PID 6984 died... 16:40:06.893252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6984): Terminated: ok {rc=0} 16:40:06.937714 --- ParallelTerminationStrategy: PID 6987 died... 16:40:06.956476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6987): Terminated: ok {rc=0} 16:40:07.040221 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:40:08.246143 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:40:08.254916 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:40:08.278694 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:40:08.305476 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:40:08.361105 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:40:08.385370 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:40:08.412019 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:40:08.961543 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:40:09.012019 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:09.023368 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:40:09.086926 tst mo_mt_call.py: using LAC 34900 16:40:09.212381 tst mo_mt_call.py: using RAC 220 16:40:09.334771 tst mo_mt_call.py: using CellId 34900 16:40:09.456529 tst mo_mt_call.py: using BVCI 34901 16:40:09.568808 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:09.580150 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:09.591263 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:09.602460 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:09.614211 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:09.625804 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:40:09.741846 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:40:09.859103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:10.339229 run create_hlr_db(pid=6993): Launched 16:40:10.466644 bus /sierra_2: Setting Powered False 16:40:11.528173 run create_hlr_db(pid=6993): Terminated: ok {rc=0} 16:40:11.980617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6995): Launched 16:40:12.315705 run osmo-hlr_10.42.42.2(pid=6996): Launched 16:40:12.445283 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:13.014830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6998): Launched 16:40:13.345688 run osmo-stp_10.42.42.5(pid=6999): Launched 16:40:13.473638 run osmo-msc_10.42.42.6: Starting osmo-msc 16:40:14.072103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7001): Launched 16:40:14.405448 run osmo-msc_10.42.42.6(pid=7002): Launched 16:40:14.593180 run osmo-stp_10.42.42.5(pid=6999): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6999)] 16:40:14.732633 run osmo-stp_10.42.42.5(pid=6999): stdout: | (launched: 2022-12-13_16:40:13.284827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:14.873171 run osmo-stp_10.42.42.5(pid=6999): stderr: | [0;m[38;5;43m20221213164013478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164013478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164013478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164013479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164013479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164013479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164013479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:15.011313 run osmo-stp_10.42.42.5(pid=6999): stdout: | (launched: 2022-12-13_16:40:13.284827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:15.143160 run osmo-stp_10.42.42.5(pid=6999): stderr: | [0;m[38;5;43m20221213164013478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164013478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164013478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164013479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164013479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164013479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164013479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:15.300604 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6999): Process ended prematurely: osmo-stp_10.42.42.5(pid=6999) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6999)] [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:40:15.310534 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:40:15.338571 run osmo-hlr_10.42.42.2(pid=6996): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6996)] 16:40:15.389420 run osmo-hlr_10.42.42.2(pid=6996): stdout: | (launched: 2022-12-13_16:40:12.254826) 16:40:15.441709 run osmo-hlr_10.42.42.2(pid=6996): stderr: | [0;m[1;31m20221213164012457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164012457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164012457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164012458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164012458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164012458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164012468 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164012478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164012478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164012478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:15.515472 run osmo-msc_10.42.42.6(pid=7002): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7002)] 16:40:15.565843 run osmo-msc_10.42.42.6(pid=7002): stdout: | (launched: 2022-12-13_16:40:14.344373) 16:40:15.618099 run osmo-msc_10.42.42.6(pid=7002): stderr: | [0;m[38;5;43m20221213164014667 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164014667 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f45a250ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164014667 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164014667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164014667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164014667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164014669 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164014670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164014670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164014670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:40:15.670600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6995): Terminating (SIGTERM) 16:40:15.712935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6998): Terminating (SIGTERM) 16:40:15.755375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7001): Terminating (SIGTERM) 16:40:15.797955 --- ParallelTerminationStrategy: PID 6995 died... 16:40:15.818413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6995): Terminated: ok {rc=0} 16:40:15.893343 --- ParallelTerminationStrategy: PID 6998 died... 16:40:15.913764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6998): Terminated: ok {rc=0} 16:40:15.966813 --- ParallelTerminationStrategy: PID 7001 died... 16:40:15.988219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7001): Terminated: ok {rc=0} 16:40:16.078398 bus /sierra_3: Setting Powered False 16:40:17.179439 bus /sierra_3: Setting Powered False 16:40:18.294865 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:40:19.444775 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:19.457530 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:40:19.521430 tst mo_mt_call_osmux.py: using LAC 34901 16:40:19.652639 tst mo_mt_call_osmux.py: using RAC 221 16:40:19.782463 tst mo_mt_call_osmux.py: using CellId 34901 16:40:19.911692 tst mo_mt_call_osmux.py: using BVCI 34902 16:40:20.031843 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:20.043687 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:20.055682 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:20.067313 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:20.079377 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:40:20.091343 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:40:20.212371 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:40:20.337303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:20.851056 run create_hlr_db(pid=7004): Launched 16:40:20.979179 bus /sierra_2: Setting Powered False 16:40:22.044553 run create_hlr_db(pid=7004): Terminated: ok {rc=0} 16:40:22.489183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7006): Launched 16:40:22.802389 run osmo-hlr_10.42.42.2(pid=7007): Launched 16:40:22.921733 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:23.461170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7009): Launched 16:40:23.774122 run osmo-stp_10.42.42.5(pid=7010): Launched 16:40:23.893876 run osmo-msc_10.42.42.6: Starting osmo-msc 16:40:24.457116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7012): Launched 16:40:24.771298 run osmo-msc_10.42.42.6(pid=7013): Launched 16:40:24.945599 run osmo-stp_10.42.42.5(pid=7010): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7010)] 16:40:25.077203 run osmo-stp_10.42.42.5(pid=7010): stdout: | (launched: 2022-12-13_16:40:23.716441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:25.208713 run osmo-stp_10.42.42.5(pid=7010): stderr: | [0;m[38;5;43m20221213164023888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164023888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164023889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164023889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164023890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164023890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164023890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:25.338158 run osmo-stp_10.42.42.5(pid=7010): stdout: | (launched: 2022-12-13_16:40:23.716441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:25.461444 run osmo-stp_10.42.42.5(pid=7010): stderr: | [0;m[38;5;43m20221213164023888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164023888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164023889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164023889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164023890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164023890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164023890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:25.609104 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7010): Process ended prematurely: osmo-stp_10.42.42.5(pid=7010) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7010)] [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:40:25.618127 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:40:25.644675 run osmo-hlr_10.42.42.2(pid=7007): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7007)] 16:40:25.692573 run osmo-hlr_10.42.42.2(pid=7007): stdout: | (launched: 2022-12-13_16:40:22.744620) 16:40:25.742190 run osmo-hlr_10.42.42.2(pid=7007): stderr: | [0;m[1;31m20221213164022920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164022920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164022920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164022920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164022920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164022920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164022933 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164022941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164022941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164022941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:25.812163 run osmo-msc_10.42.42.6(pid=7013): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7013)] 16:40:25.859913 run osmo-msc_10.42.42.6(pid=7013): stdout: | (launched: 2022-12-13_16:40:24.713507) 16:40:25.909625 run osmo-msc_10.42.42.6(pid=7013): stderr: | [0;m[38;5;43m20221213164024989 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164024990 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1779cc4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164024990 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164024990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164024990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164024990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164024992 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164024992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164024992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164024992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:40:25.959526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7006): Terminating (SIGTERM) 16:40:25.999158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7009): Terminating (SIGTERM) 16:40:26.038728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7012): Terminating (SIGTERM) 16:40:26.078707 --- ParallelTerminationStrategy: PID 7006 died... 16:40:26.097840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7006): Terminated: ok {rc=0} 16:40:26.141861 --- ParallelTerminationStrategy: PID 7009 died... 16:40:26.160478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7009): Terminated: ok {rc=0} 16:40:26.204383 --- ParallelTerminationStrategy: PID 7012 died... 16:40:26.223037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7012): Terminated: ok {rc=0} 16:40:26.308427 bus /sierra_3: Setting Powered False 16:40:27.408421 bus /sierra_3: Setting Powered False 16:40:28.521946 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:40:29.771379 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:40:29.779528 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:40:29.804186 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:40:29.832452 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:40:29.888519 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:40:29.912271 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:40:29.938864 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:40:30.490972 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:40:30.540816 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:30.552123 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:40:30.613266 tst mo_mt_call.py: using LAC 34902 16:40:30.735853 tst mo_mt_call.py: using RAC 222 16:40:30.880110 tst mo_mt_call.py: using CellId 34902 16:40:31.020011 tst mo_mt_call.py: using BVCI 34903 16:40:31.137834 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:31.150254 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:31.163595 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:31.176199 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:31.188537 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:31.200267 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:40:31.315967 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:40:31.437699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:31.982189 run create_hlr_db(pid=7018): Launched 16:40:32.145894 bus /sierra_2: Setting Powered False 16:40:33.207715 run create_hlr_db(pid=7018): Terminated: ok {rc=0} 16:40:33.661011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7020): Launched 16:40:33.994324 run osmo-hlr_10.42.42.2(pid=7021): Launched 16:40:34.123544 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:34.696583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7023): Launched 16:40:35.028757 run osmo-stp_10.42.42.5(pid=7024): Launched 16:40:35.156749 run osmo-msc_10.42.42.6: Starting osmo-msc 16:40:35.756194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7026): Launched 16:40:36.090580 run osmo-msc_10.42.42.6(pid=7027): Launched 16:40:36.276765 run osmo-stp_10.42.42.5(pid=7024): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7024)] 16:40:36.416015 run osmo-stp_10.42.42.5(pid=7024): stdout: | (launched: 2022-12-13_16:40:34.967625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:36.556399 run osmo-stp_10.42.42.5(pid=7024): stderr: | [0;m[38;5;43m20221213164035163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164035163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164035163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164035163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164035164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164035164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164035164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:36.694457 run osmo-stp_10.42.42.5(pid=7024): stdout: | (launched: 2022-12-13_16:40:34.967625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:36.825923 run osmo-stp_10.42.42.5(pid=7024): stderr: | [0;m[38;5;43m20221213164035163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164035163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164035163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164035163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164035164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164035164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164035164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:36.983320 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7024): Process ended prematurely: osmo-stp_10.42.42.5(pid=7024) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7024)] [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:40:36.992934 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:40:37.021078 run osmo-hlr_10.42.42.2(pid=7021): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7021)] 16:40:37.072025 run osmo-hlr_10.42.42.2(pid=7021): stdout: | (launched: 2022-12-13_16:40:33.933500) 16:40:37.124311 run osmo-hlr_10.42.42.2(pid=7021): stderr: | [0;m[1;31m20221213164034130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164034130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164034130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164034130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164034130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164034130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164034143 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164034153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164034153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164034153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:37.197671 run osmo-msc_10.42.42.6(pid=7027): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7027)] 16:40:37.248055 run osmo-msc_10.42.42.6(pid=7027): stdout: | (launched: 2022-12-13_16:40:36.029435) 16:40:37.300377 run osmo-msc_10.42.42.6(pid=7027): stderr: | [0;m[38;5;43m20221213164036353 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164036353 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8d8e805c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164036353 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164036353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164036353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164036353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164036355 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164036355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164036355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164036356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:40:37.352939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7020): Terminating (SIGTERM) 16:40:37.395166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7023): Terminating (SIGTERM) 16:40:37.437284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7026): Terminating (SIGTERM) 16:40:37.479881 --- ParallelTerminationStrategy: PID 7020 died... 16:40:37.500509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7020): Terminated: ok {rc=0} 16:40:37.547295 --- ParallelTerminationStrategy: PID 7023 died... 16:40:37.567235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7023): Terminated: ok {rc=0} 16:40:37.613606 --- ParallelTerminationStrategy: PID 7026 died... 16:40:37.633519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7026): Terminated: ok {rc=0} 16:40:37.721743 bus /sierra_3: Setting Powered False 16:40:38.821629 bus /sierra_3: Setting Powered False 16:40:39.939720 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:40:41.086466 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:41.098882 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:40:41.159327 tst mo_mt_call_osmux.py: using LAC 34903 16:40:41.280871 tst mo_mt_call_osmux.py: using RAC 223 16:40:41.402338 tst mo_mt_call_osmux.py: using CellId 34903 16:40:41.525987 tst mo_mt_call_osmux.py: using BVCI 34904 16:40:41.640482 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:41.651855 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:41.663222 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:41.674364 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:41.685620 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:40:41.696671 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:40:41.819230 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:40:41.939262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:42.422280 run create_hlr_db(pid=7029): Launched 16:40:42.554015 bus /sierra_2: Setting Powered False 16:40:43.619610 run create_hlr_db(pid=7029): Terminated: ok {rc=0} 16:40:44.081178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7031): Launched 16:40:44.415451 run osmo-hlr_10.42.42.2(pid=7032): Launched 16:40:44.544921 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:45.116936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7034): Launched 16:40:45.449509 run osmo-stp_10.42.42.5(pid=7035): Launched 16:40:45.578204 run osmo-msc_10.42.42.6: Starting osmo-msc 16:40:46.183091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7037): Launched 16:40:46.584590 run osmo-msc_10.42.42.6(pid=7038): Launched 16:40:46.854664 run osmo-stp_10.42.42.5(pid=7035): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7035)] 16:40:47.223294 run osmo-stp_10.42.42.5(pid=7035): stdout: | (launched: 2022-12-13_16:40:45.388178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:47.440772 run osmo-stp_10.42.42.5(pid=7035): stderr: | [0;m[38;5;43m20221213164045583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164045583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164045583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164045583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164045584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164045584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164045584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:47.581182 run osmo-stp_10.42.42.5(pid=7035): stdout: | (launched: 2022-12-13_16:40:45.388178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:47.713201 run osmo-stp_10.42.42.5(pid=7035): stderr: | [0;m[38;5;43m20221213164045583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164045583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164045583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164045583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164045584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164045584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164045584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:47.871091 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7035): Process ended prematurely: osmo-stp_10.42.42.5(pid=7035) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7035)] [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:40:47.880906 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 16:40:47.909151 run osmo-hlr_10.42.42.2(pid=7032): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7032)] 16:40:47.960408 run osmo-hlr_10.42.42.2(pid=7032): stdout: | (launched: 2022-12-13_16:40:44.354748) 16:40:48.012830 run osmo-hlr_10.42.42.2(pid=7032): stderr: | [0;m[1;31m20221213164044554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164044554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164044554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164044554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164044554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164044554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164044567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164044577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164044577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164044577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:48.086534 run osmo-msc_10.42.42.6(pid=7038): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7038)] 16:40:48.137221 run osmo-msc_10.42.42.6(pid=7038): stdout: | (launched: 2022-12-13_16:40:46.523980) 16:40:48.189890 run osmo-msc_10.42.42.6(pid=7038): stderr: | [0;m[38;5;43m20221213164047125 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164047126 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fde3f387c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164047126 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164047126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164047126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164047127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164047129 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164047130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164047131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164047131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:40:48.242817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7031): Terminating (SIGTERM) 16:40:48.285288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7034): Terminating (SIGTERM) 16:40:48.327965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7037): Terminating (SIGTERM) 16:40:48.371290 --- ParallelTerminationStrategy: PID 7031 died... 16:40:48.391958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7031): Terminated: ok {rc=0} 16:40:48.439048 --- ParallelTerminationStrategy: PID 7034 died... 16:40:48.458993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7034): Terminated: ok {rc=0} 16:40:48.505806 --- ParallelTerminationStrategy: PID 7037 died... 16:40:48.526282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7037): Terminated: ok {rc=0} 16:40:48.615549 bus /sierra_3: Setting Powered False 16:40:49.714095 bus /sierra_3: Setting Powered False 16:40:50.830449 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:40:52.078341 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:40:52.086553 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:40:52.111266 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:40:52.139775 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:40:52.193343 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:40:52.218368 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:40:52.246586 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:40:52.799868 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:40:52.853345 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:40:52.865414 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:40:52.927887 tst mo_mt_call.py: using LAC 34904 16:40:53.058858 tst mo_mt_call.py: using RAC 224 16:40:53.193655 tst mo_mt_call.py: using CellId 34904 16:40:53.323752 tst mo_mt_call.py: using BVCI 34905 16:40:53.444042 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:40:53.456011 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:40:53.467787 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:40:53.479599 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:40:53.491905 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:40:53.504011 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:40:53.622834 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:40:53.744371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:54.228249 run create_hlr_db(pid=7045): Launched 16:40:54.356805 bus /sierra_2: Setting Powered False 16:40:55.422665 run create_hlr_db(pid=7045): Terminated: ok {rc=0} 16:40:55.885043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7047): Launched 16:40:56.218299 run osmo-hlr_10.42.42.2(pid=7048): Launched 16:40:56.347819 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:56.923471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7050): Launched 16:40:57.257410 run osmo-stp_10.42.42.5(pid=7051): Launched 16:40:57.384735 run osmo-msc_10.42.42.6: Starting osmo-msc 16:40:57.983770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7053): Launched 16:40:58.319057 run osmo-msc_10.42.42.6(pid=7054): Launched 16:40:58.506171 run osmo-stp_10.42.42.5(pid=7051): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7051)] 16:40:58.650880 run osmo-stp_10.42.42.5(pid=7051): stdout: | (launched: 2022-12-13_16:40:57.195828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:58.791948 run osmo-stp_10.42.42.5(pid=7051): stderr: | [0;m[38;5;43m20221213164057390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164057390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164057391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164057391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164057392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164057392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164057392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:58.925246 run osmo-stp_10.42.42.5(pid=7051): stdout: | (launched: 2022-12-13_16:40:57.195828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:59.048500 run osmo-stp_10.42.42.5(pid=7051): stderr: | [0;m[38;5;43m20221213164057390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164057390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164057391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164057391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164057392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164057392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164057392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:59.196457 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7051): Process ended prematurely: osmo-stp_10.42.42.5(pid=7051) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7051)] [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:40:59.205720 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:40:59.232800 run osmo-hlr_10.42.42.2(pid=7048): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7048)] 16:40:59.281288 run osmo-hlr_10.42.42.2(pid=7048): stdout: | (launched: 2022-12-13_16:40:56.157432) 16:40:59.330938 run osmo-hlr_10.42.42.2(pid=7048): stderr: | [0;m[1;31m20221213164056358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164056358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164056358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164056358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164056358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164056358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164056370 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164056379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164056379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164056379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:59.400557 run osmo-msc_10.42.42.6(pid=7054): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7054)] 16:40:59.448545 run osmo-msc_10.42.42.6(pid=7054): stdout: | (launched: 2022-12-13_16:40:58.257771) 16:40:59.498280 run osmo-msc_10.42.42.6(pid=7054): stderr: | [0;m[38;5;43m20221213164058584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164058584 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8b51e3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164058584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164058584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164058584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164058584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164058586 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164058586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164058587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164058587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:40:59.548243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7047): Terminating (SIGTERM) 16:40:59.588038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7050): Terminating (SIGTERM) 16:40:59.627953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7053): Terminating (SIGTERM) 16:40:59.668099 --- ParallelTerminationStrategy: PID 7047 died... 16:40:59.687673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7047): Terminated: ok {rc=0} 16:40:59.731978 --- ParallelTerminationStrategy: PID 7050 died... 16:40:59.750705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7050): Terminated: ok {rc=0} 16:40:59.795020 --- ParallelTerminationStrategy: PID 7053 died... 16:40:59.814064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7053): Terminated: ok {rc=0} 16:40:59.900122 bus /sierra_3: Setting Powered False 16:41:01.000346 bus /sierra_3: Setting Powered False 16:41:02.131222 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:41:03.278199 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:41:03.290429 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:41:03.351300 tst mo_mt_call_osmux.py: using LAC 34905 16:41:03.473764 tst mo_mt_call_osmux.py: using RAC 225 16:41:03.605239 tst mo_mt_call_osmux.py: using CellId 34905 16:41:03.739436 tst mo_mt_call_osmux.py: using BVCI 34906 16:41:03.859932 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:41:03.872126 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:41:03.884022 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:41:03.895852 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:41:03.907956 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:41:03.920043 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:41:04.041899 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:41:04.162727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:04.646143 run create_hlr_db(pid=7056): Launched 16:41:04.774728 bus /sierra_2: Setting Powered False 16:41:05.836023 run create_hlr_db(pid=7056): Terminated: ok {rc=0} 16:41:06.269782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7058): Launched 16:41:06.582720 run osmo-hlr_10.42.42.2(pid=7059): Launched 16:41:06.703826 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:07.243260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7061): Launched 16:41:07.558080 run osmo-stp_10.42.42.5(pid=7062): Launched 16:41:07.677017 run osmo-msc_10.42.42.6: Starting osmo-msc 16:41:08.259397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7064): Launched 16:41:08.574139 run osmo-msc_10.42.42.6(pid=7065): Launched 16:41:08.755290 run osmo-stp_10.42.42.5(pid=7062): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7062)] 16:41:08.887490 run osmo-stp_10.42.42.5(pid=7062): stdout: | (launched: 2022-12-13_16:41:07.499008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:09.019030 run osmo-stp_10.42.42.5(pid=7062): stderr: | [0;m[38;5;43m20221213164107675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164107675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164107675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164107676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164107676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164107677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164107677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:09.148785 run osmo-stp_10.42.42.5(pid=7062): stdout: | (launched: 2022-12-13_16:41:07.499008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:09.272661 run osmo-stp_10.42.42.5(pid=7062): stderr: | [0;m[38;5;43m20221213164107675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164107675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164107675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164107676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164107676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164107677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164107677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:09.420777 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7062): Process ended prematurely: osmo-stp_10.42.42.5(pid=7062) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7062)] [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:41:09.429983 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:41:09.456672 run osmo-hlr_10.42.42.2(pid=7059): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7059)] 16:41:09.504635 run osmo-hlr_10.42.42.2(pid=7059): stdout: | (launched: 2022-12-13_16:41:06.524205) 16:41:09.554330 run osmo-hlr_10.42.42.2(pid=7059): stderr: | [0;m[1;31m20221213164106703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164106703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164106703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164106703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164106703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164106703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164106715 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164106724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164106725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164106725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:09.623840 run osmo-msc_10.42.42.6(pid=7065): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7065)] 16:41:09.671436 run osmo-msc_10.42.42.6(pid=7065): stdout: | (launched: 2022-12-13_16:41:08.515754) 16:41:09.720857 run osmo-msc_10.42.42.6(pid=7065): stderr: | [0;m[38;5;43m20221213164108790 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164108790 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcbcd385c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164108790 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164108790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164108790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164108790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164108792 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164108793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164108793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164108793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:41:09.770810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7058): Terminating (SIGTERM) 16:41:09.810890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7061): Terminating (SIGTERM) 16:41:09.850702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7064): Terminating (SIGTERM) 16:41:09.890811 --- ParallelTerminationStrategy: PID 7058 died... 16:41:09.910257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7058): Terminated: ok {rc=0} 16:41:09.954314 --- ParallelTerminationStrategy: PID 7061 died... 16:41:09.973067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7061): Terminated: ok {rc=0} 16:41:10.016929 --- ParallelTerminationStrategy: PID 7064 died... 16:41:10.035620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7064): Terminated: ok {rc=0} 16:41:10.121295 bus /sierra_3: Setting Powered False 16:41:11.221620 bus /sierra_3: Setting Powered False 16:41:12.338802 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:41:13.579374 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:41:13.586814 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:41:13.610624 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:41:13.637240 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:41:13.688891 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:41:13.712612 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:41:13.739038 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:41:14.293941 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:41:14.343580 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:14.354996 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:41:14.414554 tst mo_mt_call.py: using LAC 34906 16:41:14.535452 tst mo_mt_call.py: using RAC 226 16:41:14.658594 tst mo_mt_call.py: using CellId 34906 16:41:14.782317 tst mo_mt_call.py: using BVCI 34907 16:41:14.896450 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:14.907774 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:14.919000 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:14.930112 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:14.941505 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:14.952591 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:41:15.074719 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:41:15.193850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:15.675661 run create_hlr_db(pid=7070): Launched 16:41:15.802329 bus /sierra_2: Setting Powered False 16:41:16.880823 run create_hlr_db(pid=7070): Terminated: ok {rc=0} 16:41:17.365228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7072): Launched 16:41:17.678359 run osmo-hlr_10.42.42.2(pid=7073): Launched 16:41:17.796316 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:18.368875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7075): Launched 16:41:18.703456 run osmo-stp_10.42.42.5(pid=7076): Launched 16:41:18.831798 run osmo-msc_10.42.42.6: Starting osmo-msc 16:41:19.431554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7078): Launched 16:41:19.766824 run osmo-msc_10.42.42.6(pid=7079): Launched 16:41:19.953378 run osmo-stp_10.42.42.5(pid=7076): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7076)] 16:41:20.093187 run osmo-stp_10.42.42.5(pid=7076): stdout: | (launched: 2022-12-13_16:41:18.642807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:20.233842 run osmo-stp_10.42.42.5(pid=7076): stderr: | [0;m[38;5;43m20221213164118838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164118838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164118838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164118839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164118839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164118839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164118839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:20.372227 run osmo-stp_10.42.42.5(pid=7076): stdout: | (launched: 2022-12-13_16:41:18.642807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:20.504202 run osmo-stp_10.42.42.5(pid=7076): stderr: | [0;m[38;5;43m20221213164118838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164118838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164118838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164118839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164118839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164118839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164118839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:20.662907 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7076): Process ended prematurely: osmo-stp_10.42.42.5(pid=7076) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7076)] [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:41:20.672936 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:41:20.701097 run osmo-hlr_10.42.42.2(pid=7073): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7073)] 16:41:20.752299 run osmo-hlr_10.42.42.2(pid=7073): stdout: | (launched: 2022-12-13_16:41:17.619795) 16:41:20.804892 run osmo-hlr_10.42.42.2(pid=7073): stderr: | [0;m[1;31m20221213164117802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164117802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164117802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164117802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164117802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164117802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164117814 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164117823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164117823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164117823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:20.878563 run osmo-msc_10.42.42.6(pid=7079): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7079)] 16:41:20.928927 run osmo-msc_10.42.42.6(pid=7079): stdout: | (launched: 2022-12-13_16:41:19.705653) 16:41:20.981763 run osmo-msc_10.42.42.6(pid=7079): stderr: | [0;m[38;5;43m20221213164120026 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164120027 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd2cadefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164120027 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164120027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164120027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164120027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164120029 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164120029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164120029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164120030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:41:21.034772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7072): Terminating (SIGTERM) 16:41:21.077409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7075): Terminating (SIGTERM) 16:41:21.120270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7078): Terminating (SIGTERM) 16:41:21.163404 --- ParallelTerminationStrategy: PID 7072 died... 16:41:21.184329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7072): Terminated: ok {rc=0} 16:41:21.231268 --- ParallelTerminationStrategy: PID 7075 died... 16:41:21.251501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7075): Terminated: ok {rc=0} 16:41:21.298415 --- ParallelTerminationStrategy: PID 7078 died... 16:41:21.318585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7078): Terminated: ok {rc=0} 16:41:21.407719 bus /sierra_3: Setting Powered False 16:41:22.506108 bus /sierra_3: Setting Powered False 16:41:23.623342 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:41:24.771267 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:24.783662 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:41:24.845156 tst mo_mt_call_osmux.py: using LAC 34907 16:41:24.967541 tst mo_mt_call_osmux.py: using RAC 227 16:41:25.093398 tst mo_mt_call_osmux.py: using CellId 34907 16:41:25.224305 tst mo_mt_call_osmux.py: using BVCI 34908 16:41:25.345540 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:25.357527 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:25.369355 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:25.381127 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:25.394036 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:41:25.406907 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:41:25.527795 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:41:25.650856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:26.164475 run create_hlr_db(pid=7081): Launched 16:41:26.292432 bus /sierra_2: Setting Powered False 16:41:27.358055 run create_hlr_db(pid=7081): Terminated: ok {rc=0} 16:41:27.819085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7083): Launched 16:41:28.150851 run osmo-hlr_10.42.42.2(pid=7084): Launched 16:41:28.279493 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:28.853446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7086): Launched 16:41:29.185947 run osmo-stp_10.42.42.5(pid=7087): Launched 16:41:29.314794 run osmo-msc_10.42.42.6: Starting osmo-msc 16:41:29.915851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7089): Launched 16:41:30.251304 run osmo-msc_10.42.42.6(pid=7090): Launched 16:41:30.439260 run osmo-stp_10.42.42.5(pid=7087): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7087)] 16:41:30.579501 run osmo-stp_10.42.42.5(pid=7087): stdout: | (launched: 2022-12-13_16:41:29.124814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:30.719963 run osmo-stp_10.42.42.5(pid=7087): stderr: | [0;m[38;5;43m20221213164129319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164129319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164129319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164129319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164129320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164129320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164129320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:30.876742 run osmo-stp_10.42.42.5(pid=7087): stdout: | (launched: 2022-12-13_16:41:29.124814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:31.013461 run osmo-stp_10.42.42.5(pid=7087): stderr: | [0;m[38;5;43m20221213164129319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164129319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164129319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164129319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164129320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164129320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164129320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:31.177693 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7087): Process ended prematurely: osmo-stp_10.42.42.5(pid=7087) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7087)] [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:41:31.188791 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:41:31.218410 run osmo-hlr_10.42.42.2(pid=7084): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7084)] 16:41:31.273836 run osmo-hlr_10.42.42.2(pid=7084): stdout: | (launched: 2022-12-13_16:41:28.089906) 16:41:31.329230 run osmo-hlr_10.42.42.2(pid=7084): stderr: | [0;m[1;31m20221213164128289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164128289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164128289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164128289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164128289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164128289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164128302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164128310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164128310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164128311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:31.405597 run osmo-msc_10.42.42.6(pid=7090): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7090)] 16:41:31.457535 run osmo-msc_10.42.42.6(pid=7090): stdout: | (launched: 2022-12-13_16:41:30.189985) 16:41:31.513388 run osmo-msc_10.42.42.6(pid=7090): stderr: | [0;m[38;5;43m20221213164130513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164130513 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54d6c4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164130513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164130513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164130513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164130514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164130515 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164130516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164130516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164130516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:41:31.569221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7083): Terminating (SIGTERM) 16:41:31.613475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7086): Terminating (SIGTERM) 16:41:31.659863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7089): Terminating (SIGTERM) 16:41:31.705378 --- ParallelTerminationStrategy: PID 7083 died... 16:41:31.727641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7083): Terminated: ok {rc=0} 16:41:31.778033 --- ParallelTerminationStrategy: PID 7086 died... 16:41:31.798958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7086): Terminated: ok {rc=0} 16:41:31.848064 --- ParallelTerminationStrategy: PID 7089 died... 16:41:31.869951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7089): Terminated: ok {rc=0} 16:41:31.962504 bus /sierra_3: Setting Powered False 16:41:33.064356 bus /sierra_3: Setting Powered False 16:41:34.181565 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:41:35.426651 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:41:35.434917 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:41:35.459584 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:41:35.488108 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:41:35.546020 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:41:35.571723 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:41:35.600061 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:41:36.149773 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:41:36.203881 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:36.215920 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:41:36.278408 tst mo_mt_call.py: using LAC 34908 16:41:36.406101 tst mo_mt_call.py: using RAC 228 16:41:36.534248 tst mo_mt_call.py: using CellId 34908 16:41:36.663699 tst mo_mt_call.py: using BVCI 34909 16:41:36.783715 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:36.795784 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:36.807442 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:36.819331 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:36.831271 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:36.843497 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:41:36.968458 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:41:37.090091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:37.603766 run create_hlr_db(pid=7095): Launched 16:41:37.731743 bus /sierra_2: Setting Powered False 16:41:38.796904 run create_hlr_db(pid=7095): Terminated: ok {rc=0} 16:41:39.259193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7097): Launched 16:41:39.592466 run osmo-hlr_10.42.42.2(pid=7098): Launched 16:41:39.721535 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:40.292563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7100): Launched 16:41:40.628326 run osmo-stp_10.42.42.5(pid=7101): Launched 16:41:40.757808 run osmo-msc_10.42.42.6: Starting osmo-msc 16:41:41.362788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7103): Launched 16:41:41.697636 run osmo-msc_10.42.42.6(pid=7104): Launched 16:41:41.886121 run osmo-stp_10.42.42.5(pid=7101): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7101)] 16:41:42.026595 run osmo-stp_10.42.42.5(pid=7101): stdout: | (launched: 2022-12-13_16:41:40.567091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:42.167843 run osmo-stp_10.42.42.5(pid=7101): stderr: | [0;m[38;5;43m20221213164140762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164140762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164140763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164140763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164140764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164140764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164140764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:42.306957 run osmo-stp_10.42.42.5(pid=7101): stdout: | (launched: 2022-12-13_16:41:40.567091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:42.439188 run osmo-stp_10.42.42.5(pid=7101): stderr: | [0;m[38;5;43m20221213164140762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164140762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164140763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164140763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164140764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164140764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164140764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:42.597948 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7101): Process ended prematurely: osmo-stp_10.42.42.5(pid=7101) [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7101)] [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:41:42.607927 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:41:42.636196 run osmo-hlr_10.42.42.2(pid=7098): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7098)] 16:41:42.687438 run osmo-hlr_10.42.42.2(pid=7098): stdout: | (launched: 2022-12-13_16:41:39.530993) 16:41:42.739967 run osmo-hlr_10.42.42.2(pid=7098): stderr: | [0;m[1;31m20221213164139729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164139729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164139729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164139730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164139730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164139730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164139743 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164139754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164139754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164139754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:42.812559 run osmo-msc_10.42.42.6(pid=7104): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7104)] 16:41:42.862724 run osmo-msc_10.42.42.6(pid=7104): stdout: | (launched: 2022-12-13_16:41:41.635799) 16:41:42.914922 run osmo-msc_10.42.42.6(pid=7104): stderr: | [0;m[38;5;43m20221213164141960 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164141960 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4ec3200c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164141960 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164141961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164141961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164141961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164141963 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164141963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164141963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164141963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:41:42.967866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7097): Terminating (SIGTERM) 16:41:43.010268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7100): Terminating (SIGTERM) 16:41:43.053350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7103): Terminating (SIGTERM) 16:41:43.096644 --- ParallelTerminationStrategy: PID 7097 died... 16:41:43.117651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7097): Terminated: ok {rc=0} 16:41:43.164792 --- ParallelTerminationStrategy: PID 7100 died... 16:41:43.185276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7100): Terminated: ok {rc=0} 16:41:43.232124 --- ParallelTerminationStrategy: PID 7103 died... 16:41:43.252378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7103): Terminated: ok {rc=0} 16:41:43.341601 bus /sierra_3: Setting Powered False 16:41:44.441576 bus /sierra_3: Setting Powered False 16:41:45.561200 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:41:46.717345 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:46.731081 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:41:46.798059 tst mo_mt_call_osmux.py: using LAC 34909 16:41:46.922315 tst mo_mt_call_osmux.py: using RAC 229 16:41:47.094194 tst mo_mt_call_osmux.py: using CellId 34909 16:41:47.225063 tst mo_mt_call_osmux.py: using BVCI 34910 16:41:47.340033 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:47.351494 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:47.362761 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:47.374098 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:47.385494 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:41:47.396680 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:41:47.520665 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:41:47.645384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:48.131657 run create_hlr_db(pid=7106): Launched 16:41:48.259092 bus /sierra_2: Setting Powered False 16:41:49.320857 run create_hlr_db(pid=7106): Terminated: ok {rc=0} 16:41:49.773753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7108): Launched 16:41:50.108213 run osmo-hlr_10.42.42.2(pid=7109): Launched 16:41:50.237254 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:50.810601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7111): Launched 16:41:51.144255 run osmo-stp_10.42.42.5(pid=7112): Launched 16:41:51.271420 run osmo-msc_10.42.42.6: Starting osmo-msc 16:41:51.872450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7114): Launched 16:41:52.206103 run osmo-msc_10.42.42.6(pid=7115): Launched 16:41:52.393128 run osmo-stp_10.42.42.5(pid=7112): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7112)] 16:41:52.532301 run osmo-stp_10.42.42.5(pid=7112): stdout: | (launched: 2022-12-13_16:41:51.083275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:52.673805 run osmo-stp_10.42.42.5(pid=7112): stderr: | [0;m[38;5;43m20221213164151276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164151276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164151276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164151277 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164151277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164151277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164151277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:52.811935 run osmo-stp_10.42.42.5(pid=7112): stdout: | (launched: 2022-12-13_16:41:51.083275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:52.943658 run osmo-stp_10.42.42.5(pid=7112): stderr: | [0;m[38;5;43m20221213164151276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164151276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164151276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164151277 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164151277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164151277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164151277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:53.101796 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7112): Process ended prematurely: osmo-stp_10.42.42.5(pid=7112) [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7112)] [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:41:53.111620 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:41:53.139774 run osmo-hlr_10.42.42.2(pid=7109): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7109)] 16:41:53.190858 run osmo-hlr_10.42.42.2(pid=7109): stdout: | (launched: 2022-12-13_16:41:50.047082) 16:41:53.243573 run osmo-hlr_10.42.42.2(pid=7109): stderr: | [0;m[1;31m20221213164150248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164150249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164150249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164150249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164150249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164150249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164150264 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164150272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164150273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164150273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:53.316709 run osmo-msc_10.42.42.6(pid=7115): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7115)] 16:41:53.367208 run osmo-msc_10.42.42.6(pid=7115): stdout: | (launched: 2022-12-13_16:41:52.144662) 16:41:53.419814 run osmo-msc_10.42.42.6(pid=7115): stderr: | [0;m[38;5;43m20221213164152467 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164152467 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd14ebedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164152467 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164152467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164152467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164152467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164152469 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164152469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164152470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164152470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:41:53.472528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7108): Terminating (SIGTERM) 16:41:53.514667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7111): Terminating (SIGTERM) 16:41:53.557283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7114): Terminating (SIGTERM) 16:41:53.600020 --- ParallelTerminationStrategy: PID 7108 died... 16:41:53.620705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7108): Terminated: ok {rc=0} 16:41:53.667407 --- ParallelTerminationStrategy: PID 7111 died... 16:41:53.687397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7111): Terminated: ok {rc=0} 16:41:53.733706 --- ParallelTerminationStrategy: PID 7114 died... 16:41:53.753734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7114): Terminated: ok {rc=0} 16:41:53.842655 bus /sierra_3: Setting Powered False 16:41:54.942377 bus /sierra_3: Setting Powered False 16:41:56.059466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 emergency:nanobts+band-1900 --------------------------------------------------------------------- 16:41:57.308091 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:41:57.315180 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:41:57.340208 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 16:41:57.369189 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 16:41:57.467954 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:41:57.492142 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 16:41:57.519183 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 16:41:58.099536 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2391 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 16:41:58.104871 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:41:58.115897 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:41:58.155579 tst emergency_mo_mt_call.py: using LAC 34910 16:41:58.274335 tst emergency_mo_mt_call.py: using RAC 230 16:41:58.393851 tst emergency_mo_mt_call.py: using CellId 34910 16:41:58.511718 tst emergency_mo_mt_call.py: using BVCI 34911 16:41:58.633278 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:41:58.644755 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:41:58.656209 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:41:58.667578 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:41:58.679149 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:41:58.690810 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:41:58.809402 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:41:58.930517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:59.437283 run create_hlr_db(pid=7120): Launched 16:41:59.564307 bus /sierra_2: Setting Powered False 16:42:00.628240 run create_hlr_db(pid=7120): Terminated: ok {rc=0} 16:42:01.238019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7124): Launched 16:42:01.679089 run osmo-hlr_10.42.42.2(pid=7125): Launched 16:42:01.995165 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:02.726876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7127): Launched 16:42:03.054816 run osmo-stp_10.42.42.5(pid=7128): Launched 16:42:03.192375 tst emergency_mo_mt_call.py: using MSISDN 8224 16:42:03.397364 run osmo-msc_10.42.42.6: Starting osmo-msc 16:42:03.985761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7130): Launched 16:42:04.313206 run osmo-msc_10.42.42.6(pid=7131): Launched 16:42:04.495890 run osmo-stp_10.42.42.5(pid=7128): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7128)] 16:42:04.633778 run osmo-stp_10.42.42.5(pid=7128): stdout: | (launched: 2022-12-13_16:42:02.994132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:04.771432 run osmo-stp_10.42.42.5(pid=7128): stderr: | [0;m[38;5;43m20221213164203188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164203188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164203188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164203188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164203190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164203190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164203190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:04.908556 run osmo-stp_10.42.42.5(pid=7128): stdout: | (launched: 2022-12-13_16:42:02.994132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:05.038635 run osmo-stp_10.42.42.5(pid=7128): stderr: | [0;m[38;5;43m20221213164203188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164203188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164203188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164203188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164203190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164203190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164203190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:05.194588 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7128): Process ended prematurely: osmo-stp_10.42.42.5(pid=7128) [trial-2391↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7128)] [trial-2391↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 16:42:05.203755 tst emergency_mo_mt_call.py:19: Test FAILED (7.1 sec) 16:42:05.231766 run osmo-hlr_10.42.42.2(pid=7125): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7125)] 16:42:05.284115 run osmo-hlr_10.42.42.2(pid=7125): stdout: | (launched: 2022-12-13_16:42:01.598832) 16:42:05.337653 run osmo-hlr_10.42.42.2(pid=7125): stderr: | [0;m[1;31m20221213164201891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164201891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164201891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164201892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164201892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164201892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164201908 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164201926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164201926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164201926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:05.411538 run osmo-msc_10.42.42.6(pid=7131): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7131)] 16:42:05.461753 run osmo-msc_10.42.42.6(pid=7131): stdout: | (launched: 2022-12-13_16:42:04.252735) 16:42:05.514256 run osmo-msc_10.42.42.6(pid=7131): stderr: | [0;m[38;5;43m20221213164204577 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164204577 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb516039c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164204577 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164204578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164204578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164204578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164204580 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164204580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164204581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164204581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:42:05.568678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7124): Terminating (SIGTERM) 16:42:05.611111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7127): Terminating (SIGTERM) 16:42:05.654490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7130): Terminating (SIGTERM) 16:42:05.697747 --- ParallelTerminationStrategy: PID 7124 died... 16:42:05.718903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7124): Terminated: ok {rc=0} 16:42:05.766269 --- ParallelTerminationStrategy: PID 7127 died... 16:42:05.786882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7127): Terminated: ok {rc=0} 16:42:05.833977 --- ParallelTerminationStrategy: PID 7130 died... 16:42:05.854587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7130): Terminated: ok {rc=0} 16:42:05.945510 bus /sierra_3: Setting Powered False 16:42:07.045666 bus /sierra_3: Setting Powered False 16:42:08.163005 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 16:42:09.251095 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:42:09.263557 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:42:09.306627 tst emergency_preemptive_call.py: using LAC 34911 16:42:09.435985 tst emergency_preemptive_call.py: using RAC 231 16:42:09.562272 tst emergency_preemptive_call.py: using CellId 34911 16:42:09.689459 tst emergency_preemptive_call.py: using BVCI 34912 16:42:09.808491 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:42:09.820018 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:42:09.831407 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:42:09.842750 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:42:09.854488 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:42:09.866163 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:42:09.983486 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:42:10.103513 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:42:10.221810 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:42:10.339950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:10.816099 run create_hlr_db(pid=7133): Launched 16:42:10.942882 bus /sierra_2: Setting Powered False 16:42:12.003877 run create_hlr_db(pid=7133): Terminated: ok {rc=0} 16:42:12.432476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7135): Launched 16:42:12.740862 run osmo-hlr_10.42.42.2(pid=7136): Launched 16:42:12.857715 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:13.398090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7138): Launched 16:42:13.705293 run osmo-stp_10.42.42.5(pid=7139): Launched 16:42:13.831276 tst emergency_preemptive_call.py: using MSISDN 8225 16:42:13.986054 run osmo-msc_10.42.42.6: Starting osmo-msc 16:42:14.534257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7141): Launched 16:42:14.843584 run osmo-msc_10.42.42.6(pid=7142): Launched 16:42:15.016070 run osmo-stp_10.42.42.5(pid=7139): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7139)] 16:42:15.145306 run osmo-stp_10.42.42.5(pid=7139): stdout: | (launched: 2022-12-13_16:42:13.647660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:15.275720 run osmo-stp_10.42.42.5(pid=7139): stderr: | [0;m[38;5;43m20221213164213821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164213821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164213822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164213822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164213823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164213823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164213823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:15.403115 run osmo-stp_10.42.42.5(pid=7139): stdout: | (launched: 2022-12-13_16:42:13.647660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:15.524405 run osmo-stp_10.42.42.5(pid=7139): stderr: | [0;m[38;5;43m20221213164213821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164213821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164213822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164213822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164213823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164213823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164213823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:15.669985 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7139): Process ended prematurely: osmo-stp_10.42.42.5(pid=7139) [trial-2391↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7139)] [trial-2391↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 16:42:15.678514 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 16:42:15.705145 run osmo-hlr_10.42.42.2(pid=7136): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7136)] 16:42:15.753327 run osmo-hlr_10.42.42.2(pid=7136): stdout: | (launched: 2022-12-13_16:42:12.683651) 16:42:15.803372 run osmo-hlr_10.42.42.2(pid=7136): stderr: | [0;m[1;31m20221213164212864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164212864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164212864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164212864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164212864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164212864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164212876 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164212887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164212887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164212887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:15.896160 run osmo-msc_10.42.42.6(pid=7142): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7142)] 16:42:15.947285 run osmo-msc_10.42.42.6(pid=7142): stdout: | (launched: 2022-12-13_16:42:14.785931) 16:42:15.997898 run osmo-msc_10.42.42.6(pid=7142): stderr: | [0;m[38;5;43m20221213164215058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164215058 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f73e0b07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164215058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164215058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164215059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164215059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164215061 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164215061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164215061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164215061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:42:16.048857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7135): Terminating (SIGTERM) 16:42:16.089854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7138): Terminating (SIGTERM) 16:42:16.131045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7141): Terminating (SIGTERM) 16:42:16.172228 --- ParallelTerminationStrategy: PID 7135 died... 16:42:16.191934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7135): Terminated: ok {rc=0} 16:42:16.237418 --- ParallelTerminationStrategy: PID 7138 died... 16:42:16.256805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7138): Terminated: ok {rc=0} 16:42:16.302692 --- ParallelTerminationStrategy: PID 7141 died... 16:42:16.322395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7141): Terminated: ok {rc=0} 16:42:16.407599 bus /sierra_9: Setting Powered False 16:42:17.503689 bus /sierra_9: Setting Powered False 16:42:18.616769 bus /sierra_8: Setting Powered False 16:42:19.714225 bus /sierra_8: Setting Powered False 16:42:20.830059 bus /sierra_3: Setting Powered False 16:42:21.928763 bus /sierra_3: Setting Powered False 16:42:23.045951 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-1900 --------------------------------------------------------------------- 16:42:24.323890 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:42:24.329859 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:42:24.354526 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 16:42:24.395101 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 16:42:24.484782 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:42:24.509448 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 16:42:24.549366 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 16:42:25.145322 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 16:42:25.199649 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:25.210996 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:42:25.250583 tst cs_paging_gprs_active.py: using LAC 34912 16:42:25.383512 tst cs_paging_gprs_active.py: using RAC 232 16:42:25.514931 tst cs_paging_gprs_active.py: using CellId 34912 16:42:25.645187 tst cs_paging_gprs_active.py: using BVCI 34913 16:42:25.767897 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:25.779349 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:25.790680 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:25.802125 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:25.813442 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:25.824761 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:25.836459 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:25.848015 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:25.859732 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:42:25.979404 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:42:26.101429 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:42:26.327123 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:26.662767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7147): Launched 16:42:26.957175 run iperf3-srv_10.42.42.10(pid=7148): Launched 16:42:27.084097 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:42:27.310159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:27.646857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7149): Launched 16:42:27.939659 run iperf3-srv_10.42.42.10(pid=7150): Launched 16:42:28.066349 tst cs_paging_gprs_active.py:38: start network... 16:42:28.290857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:28.808040 run create_hlr_db(pid=7151): Launched 16:42:28.938688 bus /sierra_2: Setting Powered False 16:42:30.004297 run create_hlr_db(pid=7151): Terminated: ok {rc=0} 16:42:30.448473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7153): Launched 16:42:30.763451 run osmo-hlr_10.42.42.2(pid=7154): Launched 16:42:30.936702 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:31.553763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7156): Launched 16:42:31.925825 run osmo-stp_10.42.42.5(pid=7157): Launched 16:42:32.116194 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:32.848058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7159): Launched 16:42:32.979408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:33.262189 run patchelf(pid=7160): Launched 16:42:33.450039 run osmo-stp_10.42.42.5(pid=7157): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7157)] 16:42:33.591563 run osmo-stp_10.42.42.5(pid=7157): stdout: | (launched: 2022-12-13_16:42:31.862390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:33.733837 run osmo-stp_10.42.42.5(pid=7157): stderr: | [0;m[38;5;43m20221213164232272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164232272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164232272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164232273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164232274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164232274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164232274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:33.876147 run osmo-stp_10.42.42.5(pid=7157): stdout: | (launched: 2022-12-13_16:42:31.862390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:34.011909 run osmo-stp_10.42.42.5(pid=7157): stderr: | [0;m[38;5;43m20221213164232272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164232272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164232272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164232273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164232274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164232274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164232274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:34.173238 run patchelf(pid=7160): Terminating (SIGINT) 16:42:34.360311 run patchelf(pid=7160): Terminated: ok {rc=0} 16:42:34.495290 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7157): Process ended prematurely: osmo-stp_10.42.42.5(pid=7157) [trial-2391↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7157)] [trial-2391↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 16:42:34.505704 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 16:42:34.534473 run osmo-hlr_10.42.42.2(pid=7154): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7154)] 16:42:34.585983 run osmo-hlr_10.42.42.2(pid=7154): stdout: | (launched: 2022-12-13_16:42:30.705028) 16:42:34.638345 run osmo-hlr_10.42.42.2(pid=7154): stderr: | [0;m[1;31m20221213164230984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164230984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164230984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164230984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164230984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164230984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164231007 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164231024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164231024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164231024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:34.691171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7147): Terminating (SIGTERM) 16:42:34.733731 run iperf3-srv_10.42.42.10(pid=7148): Terminating (SIGTERM) 16:42:34.776162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7149): Terminating (SIGTERM) 16:42:34.818682 run iperf3-srv_10.42.42.10(pid=7150): Terminating (SIGTERM) 16:42:34.860827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7153): Terminating (SIGTERM) 16:42:34.903364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7156): Terminating (SIGTERM) 16:42:34.945659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7159): Terminating (SIGTERM) 16:42:34.988260 --- ParallelTerminationStrategy: PID 7147 died... 16:42:35.008289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7147): Terminated: ok {rc=0} 16:42:35.055495 --- ParallelTerminationStrategy: PID 7148 died... 16:42:35.075430 run iperf3-srv_10.42.42.10(pid=7148): Terminated {rc=256} 16:42:35.121571 --- ParallelTerminationStrategy: PID 7149 died... 16:42:35.141402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7149): Terminated: ok {rc=0} 16:42:35.187494 --- ParallelTerminationStrategy: PID 7150 died... 16:42:35.207423 run iperf3-srv_10.42.42.10(pid=7150): Terminated {rc=256} 16:42:35.253577 --- ParallelTerminationStrategy: PID 7153 died... 16:42:35.273504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7153): Terminated: ok {rc=0} 16:42:35.319798 --- ParallelTerminationStrategy: PID 7156 died... 16:42:35.339691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7156): Terminated: ok {rc=0} 16:42:35.386084 --- ParallelTerminationStrategy: PID 7159 died... 16:42:35.406064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7159): Terminated: ok {rc=0} 16:42:35.495048 bus /gobi_0: Setting Powered False 16:42:36.590752 bus /gobi_0: Setting Powered False 16:42:37.703913 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 16:42:38.853254 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:38.864862 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:42:38.904620 tst iperf3.py: using LAC 34913 16:42:39.029570 tst iperf3.py: using RAC 233 16:42:39.161108 tst iperf3.py: using CellId 34913 16:42:39.285523 tst iperf3.py: using BVCI 34914 16:42:39.401163 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:39.412168 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:39.423147 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:39.434030 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:39.444887 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:39.455552 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:39.466416 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:39.477272 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:39.488125 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:42:39.609302 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:42:39.819055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:40.147019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7161): Launched 16:42:40.439481 run iperf3-srv_10.42.42.10(pid=7162): Launched 16:42:40.566038 tst iperf3.py:8: start network... 16:42:40.790610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:41.306420 run create_hlr_db(pid=7163): Launched 16:42:41.435699 bus /gobi_6: Setting Powered False 16:42:42.500793 run create_hlr_db(pid=7163): Terminated: ok {rc=0} 16:42:42.962924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7165): Launched 16:42:43.296134 run osmo-hlr_10.42.42.2(pid=7166): Launched 16:42:43.425290 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:43.978179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7168): Launched 16:42:44.291648 run osmo-stp_10.42.42.5(pid=7169): Launched 16:42:44.411170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:44.952299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7171): Launched 16:42:45.074188 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:45.341383 run patchelf(pid=7172): Launched 16:42:45.516865 run osmo-stp_10.42.42.5(pid=7169): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7169)] 16:42:45.649846 run osmo-stp_10.42.42.5(pid=7169): stdout: | (launched: 2022-12-13_16:42:44.233858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:45.784123 run osmo-stp_10.42.42.5(pid=7169): stderr: | [0;m[38;5;43m20221213164244407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164244407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164244408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164244408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164244408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164244409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164244409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:45.948280 run osmo-stp_10.42.42.5(pid=7169): stdout: | (launched: 2022-12-13_16:42:44.233858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:46.089521 run osmo-stp_10.42.42.5(pid=7169): stderr: | [0;m[38;5;43m20221213164244407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164244407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164244408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164244408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164244408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164244409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164244409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:46.257161 run patchelf(pid=7172): Terminating (SIGINT) 16:42:46.450554 run patchelf(pid=7172): Terminated: ok {rc=0} 16:42:46.591686 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7169): Process ended prematurely: osmo-stp_10.42.42.5(pid=7169) [trial-2391↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7169)] [trial-2391↪gprs:nanobts+band-1900↪iperf3.py:8] 16:42:46.603558 tst iperf3.py:8: Test FAILED (7.8 sec) 16:42:46.635001 run osmo-hlr_10.42.42.2(pid=7166): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7166)] 16:42:46.690205 run osmo-hlr_10.42.42.2(pid=7166): stdout: | (launched: 2022-12-13_16:42:43.234727) 16:42:46.746029 run osmo-hlr_10.42.42.2(pid=7166): stderr: | [0;m[1;31m20221213164243435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164243435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164243435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164243435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164243435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164243435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164243447 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164243456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164243456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164243456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:46.804064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7161): Terminating (SIGTERM) 16:42:46.849066 run iperf3-srv_10.42.42.10(pid=7162): Terminating (SIGTERM) 16:42:46.895615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7165): Terminating (SIGTERM) 16:42:46.940743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7168): Terminating (SIGTERM) 16:42:46.987475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7171): Terminating (SIGTERM) 16:42:47.035199 --- ParallelTerminationStrategy: PID 7161 died... 16:42:47.057523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7161): Terminated: ok {rc=0} 16:42:47.107918 --- ParallelTerminationStrategy: PID 7162 died... 16:42:47.129794 run iperf3-srv_10.42.42.10(pid=7162): Terminated {rc=256} 16:42:47.178961 --- ParallelTerminationStrategy: PID 7165 died... 16:42:47.199817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7165): Terminated: ok {rc=0} 16:42:47.247337 --- ParallelTerminationStrategy: PID 7168 died... 16:42:47.268139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7168): Terminated: ok {rc=0} 16:42:47.315817 --- ParallelTerminationStrategy: PID 7171 died... 16:42:47.336785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7171): Terminated: ok {rc=0} 16:42:47.427144 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 16:42:48.581453 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:48.593627 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:42:48.635590 tst iperf3m4.py: using LAC 34914 16:42:48.768422 tst iperf3m4.py: using RAC 234 16:42:48.900063 tst iperf3m4.py: using CellId 34914 16:42:49.032528 tst iperf3m4.py: using BVCI 34915 16:42:49.155517 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:49.166983 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:49.178239 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:49.189579 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:49.201450 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:49.213359 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:49.225438 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:49.237527 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:42:49.249941 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:42:49.371985 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:42:49.498036 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:42:49.620657 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:42:49.739629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:42:49.950518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:50.267674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7173): Launched 16:42:50.541475 run iperf3-srv_10.42.42.10(pid=7174): Launched 16:42:50.658954 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:42:50.866629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:51.180402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7175): Launched 16:42:51.453187 run iperf3-srv_10.42.42.10(pid=7176): Launched 16:42:51.571683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:42:51.780392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:52.095396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7177): Launched 16:42:52.369458 run iperf3-srv_10.42.42.10(pid=7178): Launched 16:42:52.486466 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:42:52.694723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:53.008445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7179): Launched 16:42:53.281669 run iperf3-srv_10.42.42.10(pid=7180): Launched 16:42:53.398731 tst iperf3m4.py:8: start network... 16:42:53.607482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:54.090362 run create_hlr_db(pid=7181): Launched 16:42:54.221358 bus /gobi_6: Setting Powered False 16:42:55.283353 run create_hlr_db(pid=7181): Terminated: ok {rc=0} 16:42:55.738654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7183): Launched 16:42:56.076076 run osmo-hlr_10.42.42.2(pid=7184): Launched 16:42:56.207015 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:56.785486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7186): Launched 16:42:57.121593 run osmo-stp_10.42.42.5(pid=7187): Launched 16:42:57.250220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:57.828880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7189): Launched 16:42:57.958593 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:58.242147 run patchelf(pid=7190): Launched 16:42:58.430517 run osmo-stp_10.42.42.5(pid=7187): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7187)] 16:42:58.571704 run osmo-stp_10.42.42.5(pid=7187): stdout: | (launched: 2022-12-13_16:42:57.059739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:58.715241 run osmo-stp_10.42.42.5(pid=7187): stderr: | [0;m[38;5;43m20221213164257251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164257251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164257251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164257252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164257252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164257252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164257252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:58.858202 run osmo-stp_10.42.42.5(pid=7187): stdout: | (launched: 2022-12-13_16:42:57.059739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:58.994638 run osmo-stp_10.42.42.5(pid=7187): stderr: | [0;m[38;5;43m20221213164257251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164257251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164257251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164257252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164257252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164257252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164257252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:59.156518 run patchelf(pid=7190): Terminating (SIGINT) 16:42:59.344225 run patchelf(pid=7190): Terminated: ok {rc=0} 16:42:59.479560 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7187): Process ended prematurely: osmo-stp_10.42.42.5(pid=7187) [trial-2391↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7187)] [trial-2391↪gprs:nanobts+band-1900↪iperf3m4.py:8] 16:42:59.490242 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:42:59.519465 run osmo-hlr_10.42.42.2(pid=7184): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7184)] 16:42:59.570746 run osmo-hlr_10.42.42.2(pid=7184): stdout: | (launched: 2022-12-13_16:42:56.014161) 16:42:59.623963 run osmo-hlr_10.42.42.2(pid=7184): stderr: | [0;m[1;31m20221213164256215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164256215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164256215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164256215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164256215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164256215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164256226 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164256235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164256235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164256235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:59.677145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7173): Terminating (SIGTERM) 16:42:59.719614 run iperf3-srv_10.42.42.10(pid=7174): Terminating (SIGTERM) 16:42:59.762246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7175): Terminating (SIGTERM) 16:42:59.805442 run iperf3-srv_10.42.42.10(pid=7176): Terminating (SIGTERM) 16:42:59.848221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7177): Terminating (SIGTERM) 16:42:59.891061 run iperf3-srv_10.42.42.10(pid=7178): Terminating (SIGTERM) 16:42:59.933615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7179): Terminating (SIGTERM) 16:42:59.976285 run iperf3-srv_10.42.42.10(pid=7180): Terminating (SIGTERM) 16:43:00.019437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7183): Terminating (SIGTERM) 16:43:00.062442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7186): Terminating (SIGTERM) 16:43:00.105490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7189): Terminating (SIGTERM) 16:43:00.148582 --- ParallelTerminationStrategy: PID 7173 died... 16:43:00.169684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7173): Terminated: ok {rc=0} 16:43:00.217408 --- ParallelTerminationStrategy: PID 7174 died... 16:43:00.237706 run iperf3-srv_10.42.42.10(pid=7174): Terminated {rc=256} 16:43:00.284863 --- ParallelTerminationStrategy: PID 7175 died... 16:43:00.305943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7175): Terminated: ok {rc=0} 16:43:00.353586 --- ParallelTerminationStrategy: PID 7176 died... 16:43:00.373892 run iperf3-srv_10.42.42.10(pid=7176): Terminated {rc=256} 16:43:00.420684 --- ParallelTerminationStrategy: PID 7177 died... 16:43:00.441080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7177): Terminated: ok {rc=0} 16:43:00.488062 --- ParallelTerminationStrategy: PID 7178 died... 16:43:00.508366 run iperf3-srv_10.42.42.10(pid=7178): Terminated {rc=256} 16:43:00.555189 --- ParallelTerminationStrategy: PID 7179 died... 16:43:00.575517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7179): Terminated: ok {rc=0} 16:43:00.622943 --- ParallelTerminationStrategy: PID 7180 died... 16:43:00.643289 run iperf3-srv_10.42.42.10(pid=7180): Terminated {rc=256} 16:43:00.690206 --- ParallelTerminationStrategy: PID 7183 died... 16:43:00.710428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7183): Terminated: ok {rc=0} 16:43:00.757317 --- ParallelTerminationStrategy: PID 7186 died... 16:43:00.777623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7186): Terminated: ok {rc=0} 16:43:00.824658 --- ParallelTerminationStrategy: PID 7189 died... 16:43:00.855623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7189): Terminated: ok {rc=0} 16:43:00.954643 bus /gobi_4: Setting Powered False 16:43:02.052660 bus /gobi_4: Setting Powered False 16:43:03.168585 bus /gobi_1: Setting Powered False 16:43:04.267673 bus /gobi_1: Setting Powered False 16:43:05.386464 bus /gobi_0: Setting Powered False 16:43:06.484998 bus /gobi_0: Setting Powered False 16:43:07.600300 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 16:43:08.704671 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:08.716427 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:43:08.756419 tst ping.py: using LAC 34915 16:43:08.878955 tst ping.py: using RAC 235 16:43:09.001701 tst ping.py: using CellId 34915 16:43:09.124382 tst ping.py: using BVCI 34916 16:43:09.237179 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:09.247929 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:09.258648 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:09.269350 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:09.280403 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:09.291605 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:09.303615 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:09.317024 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:43:09.438170 tst ping.py:19: start network... 16:43:09.659753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:10.165703 run create_hlr_db(pid=7191): Launched 16:43:10.291790 bus /gobi_6: Setting Powered False 16:43:11.357229 run create_hlr_db(pid=7191): Terminated: ok {rc=0} 16:43:11.814617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7193): Launched 16:43:12.142757 run osmo-hlr_10.42.42.2(pid=7194): Launched 16:43:12.269678 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:12.833463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7196): Launched 16:43:13.162056 run osmo-stp_10.42.42.5(pid=7197): Launched 16:43:13.286916 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:43:13.852687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7199): Launched 16:43:13.978432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:43:14.255134 run patchelf(pid=7200): Launched 16:43:14.436786 run osmo-stp_10.42.42.5(pid=7197): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7197)] 16:43:14.575287 run osmo-stp_10.42.42.5(pid=7197): stdout: | (launched: 2022-12-13_16:43:13.101251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:14.716328 run osmo-stp_10.42.42.5(pid=7197): stderr: | [0;m[38;5;43m20221213164313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164313295 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164313295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164313295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164313295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:14.856610 run osmo-stp_10.42.42.5(pid=7197): stdout: | (launched: 2022-12-13_16:43:13.101251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:14.990447 run osmo-stp_10.42.42.5(pid=7197): stderr: | [0;m[38;5;43m20221213164313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164313294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164313295 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164313295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164313295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164313295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:15.149105 run patchelf(pid=7200): Terminating (SIGINT) 16:43:15.333188 run patchelf(pid=7200): Terminated: ok {rc=0} 16:43:15.466067 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7197): Process ended prematurely: osmo-stp_10.42.42.5(pid=7197) [trial-2391↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7197)] [trial-2391↪gprs:nanobts+band-1900↪ping.py:22] 16:43:15.475799 tst ping.py:22: Test FAILED (6.8 sec) 16:43:15.504352 run osmo-hlr_10.42.42.2(pid=7194): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7194)] 16:43:15.555717 run osmo-hlr_10.42.42.2(pid=7194): stdout: | (launched: 2022-12-13_16:43:12.082088) 16:43:15.609088 run osmo-hlr_10.42.42.2(pid=7194): stderr: | [0;m[1;31m20221213164312282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164312282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164312282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164312282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164312282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164312282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164312294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164312303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164312303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164312303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:15.661727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7193): Terminating (SIGTERM) 16:43:15.704637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7196): Terminating (SIGTERM) 16:43:15.747237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7199): Terminating (SIGTERM) 16:43:15.789984 --- ParallelTerminationStrategy: PID 7193 died... 16:43:15.810951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7193): Terminated: ok {rc=0} 16:43:15.858963 --- ParallelTerminationStrategy: PID 7196 died... 16:43:15.880468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7196): Terminated: ok {rc=0} 16:43:15.935867 --- ParallelTerminationStrategy: PID 7199 died... 16:43:15.956276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7199): Terminated: ok {rc=0} 16:43:16.054222 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 16:43:17.143148 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:17.156649 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:43:17.199487 tst ping_idle_ping.py: using LAC 34916 16:43:17.320532 tst ping_idle_ping.py: using RAC 236 16:43:17.441025 tst ping_idle_ping.py: using CellId 34916 16:43:17.559254 tst ping_idle_ping.py: using BVCI 34917 16:43:17.670838 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:17.682242 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:17.693353 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:17.704278 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:17.715147 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:17.725758 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:17.736525 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:43:17.747335 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:43:17.869090 tst ping_idle_ping.py:24: start network... 16:43:18.090328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:18.600197 run create_hlr_db(pid=7201): Launched 16:43:18.727810 bus /gobi_6: Setting Powered False 16:43:19.792096 run create_hlr_db(pid=7201): Terminated: ok {rc=0} 16:43:20.233357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7203): Launched 16:43:20.542553 run osmo-hlr_10.42.42.2(pid=7204): Launched 16:43:20.661425 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:21.196348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7206): Launched 16:43:21.506069 run osmo-stp_10.42.42.5(pid=7207): Launched 16:43:21.626141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:43:22.159512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7209): Launched 16:43:22.279931 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:43:22.540362 run patchelf(pid=7210): Launched 16:43:22.714731 run osmo-stp_10.42.42.5(pid=7207): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7207)] 16:43:22.845195 run osmo-stp_10.42.42.5(pid=7207): stdout: | (launched: 2022-12-13_16:43:21.448500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:22.977586 run osmo-stp_10.42.42.5(pid=7207): stderr: | [0;m[38;5;43m20221213164321621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164321621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164321622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164321622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164321623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164321623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164321623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:23.109981 run osmo-stp_10.42.42.5(pid=7207): stdout: | (launched: 2022-12-13_16:43:21.448500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:23.235870 run osmo-stp_10.42.42.5(pid=7207): stderr: | [0;m[38;5;43m20221213164321621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164321621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164321622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164321622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164321623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164321623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164321623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:23.385310 run patchelf(pid=7210): Terminating (SIGINT) 16:43:23.558268 run patchelf(pid=7210): Terminated: ok {rc=0} 16:43:23.682964 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7207): Process ended prematurely: osmo-stp_10.42.42.5(pid=7207) [trial-2391↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7207)] [trial-2391↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 16:43:23.692153 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:43:23.719457 run osmo-hlr_10.42.42.2(pid=7204): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7204)] 16:43:23.767910 run osmo-hlr_10.42.42.2(pid=7204): stdout: | (launched: 2022-12-13_16:43:20.485050) 16:43:23.817849 run osmo-hlr_10.42.42.2(pid=7204): stderr: | [0;m[1;31m20221213164320664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164320664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164320664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164320664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164320664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164320664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164320676 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164320684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164320685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164320685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:23.868080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7203): Terminating (SIGTERM) 16:43:23.908517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7206): Terminating (SIGTERM) 16:43:23.948842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7209): Terminating (SIGTERM) 16:43:23.989581 --- ParallelTerminationStrategy: PID 7203 died... 16:43:24.008594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7203): Terminated: ok {rc=0} 16:43:24.053224 --- ParallelTerminationStrategy: PID 7206 died... 16:43:24.072292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7206): Terminated: ok {rc=0} 16:43:24.116767 --- ParallelTerminationStrategy: PID 7209 died... 16:43:24.135904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7209): Terminated: ok {rc=0} 16:43:24.223151 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 16:43:25.523327 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:25.529743 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:43:25.553673 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:43:25.592817 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:43:25.682075 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:43:25.706703 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:43:25.745688 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:43:26.339124 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:43:26.389572 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:26.400721 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:43:26.440929 tst cs_paging_gprs_active.py: using LAC 34917 16:43:26.566861 tst cs_paging_gprs_active.py: using RAC 237 16:43:26.690386 tst cs_paging_gprs_active.py: using CellId 34917 16:43:26.813134 tst cs_paging_gprs_active.py: using BVCI 34918 16:43:26.926776 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:26.937944 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:26.948692 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:26.959568 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:26.970339 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:26.981820 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:26.992851 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:27.003767 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:27.014934 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:43:27.136109 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:43:27.256748 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:43:27.467864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:43:27.784107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7214): Launched 16:43:28.058971 run iperf3-srv_10.42.42.10(pid=7215): Launched 16:43:28.178862 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:43:28.388829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:43:28.705188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7216): Launched 16:43:28.978896 run iperf3-srv_10.42.42.10(pid=7217): Launched 16:43:29.098427 tst cs_paging_gprs_active.py:38: start network... 16:43:29.307768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:29.792396 run create_hlr_db(pid=7218): Launched 16:43:29.921075 bus /gobi_6: Setting Powered False 16:43:30.991085 run create_hlr_db(pid=7218): Terminated: ok {rc=0} 16:43:31.489740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7220): Launched 16:43:31.840256 run osmo-hlr_10.42.42.2(pid=7221): Launched 16:43:32.084228 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:32.642970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7223): Launched 16:43:32.957811 run osmo-stp_10.42.42.5(pid=7224): Launched 16:43:33.091867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:43:33.671463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7226): Launched 16:43:33.799837 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:43:34.082413 run patchelf(pid=7227): Launched 16:43:34.268251 run osmo-stp_10.42.42.5(pid=7224): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7224)] 16:43:34.409957 run osmo-stp_10.42.42.5(pid=7224): stdout: | (launched: 2022-12-13_16:43:32.899831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:34.552767 run osmo-stp_10.42.42.5(pid=7224): stderr: | [0;m[38;5;43m20221213164333088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164333088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164333089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164333089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164333090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164333090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164333090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:34.696843 run osmo-stp_10.42.42.5(pid=7224): stdout: | (launched: 2022-12-13_16:43:32.899831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:34.833399 run osmo-stp_10.42.42.5(pid=7224): stderr: | [0;m[38;5;43m20221213164333088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164333088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164333089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164333089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164333090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164333090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164333090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:34.995631 run patchelf(pid=7227): Terminating (SIGINT) 16:43:35.183265 run patchelf(pid=7227): Terminated: ok {rc=0} 16:43:35.318807 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7224): Process ended prematurely: osmo-stp_10.42.42.5(pid=7224) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7224)] [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:43:35.329387 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:43:35.358557 run osmo-hlr_10.42.42.2(pid=7221): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7221)] 16:43:35.409900 run osmo-hlr_10.42.42.2(pid=7221): stdout: | (launched: 2022-12-13_16:43:31.776255) 16:43:35.462494 run osmo-hlr_10.42.42.2(pid=7221): stderr: | [0;m[1;31m20221213164332088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164332088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164332088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164332088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164332088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164332088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164332112 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164332139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164332139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164332139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:35.515638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7214): Terminating (SIGTERM) 16:43:35.558378 run iperf3-srv_10.42.42.10(pid=7215): Terminating (SIGTERM) 16:43:35.601468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7216): Terminating (SIGTERM) 16:43:35.644386 run iperf3-srv_10.42.42.10(pid=7217): Terminating (SIGTERM) 16:43:35.686991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7220): Terminating (SIGTERM) 16:43:35.729670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7223): Terminating (SIGTERM) 16:43:35.772348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7226): Terminating (SIGTERM) 16:43:35.815327 --- ParallelTerminationStrategy: PID 7214 died... 16:43:35.835976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7214): Terminated: ok {rc=0} 16:43:35.883166 --- ParallelTerminationStrategy: PID 7215 died... 16:43:35.903317 run iperf3-srv_10.42.42.10(pid=7215): Terminated {rc=256} 16:43:35.949910 --- ParallelTerminationStrategy: PID 7216 died... 16:43:35.969878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7216): Terminated: ok {rc=0} 16:43:36.016379 --- ParallelTerminationStrategy: PID 7217 died... 16:43:36.036282 run iperf3-srv_10.42.42.10(pid=7217): Terminated {rc=256} 16:43:36.083056 --- ParallelTerminationStrategy: PID 7220 died... 16:43:36.103067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7220): Terminated: ok {rc=0} 16:43:36.149778 --- ParallelTerminationStrategy: PID 7223 died... 16:43:36.169815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7223): Terminated: ok {rc=0} 16:43:36.216220 --- ParallelTerminationStrategy: PID 7226 died... 16:43:36.236367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7226): Terminated: ok {rc=0} 16:43:36.325551 bus /gobi_0: Setting Powered False 16:43:37.426363 bus /gobi_0: Setting Powered False 16:43:38.543412 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:43:39.696209 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:39.708708 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:43:39.754331 tst iperf3.py: using LAC 34918 16:43:39.886196 tst iperf3.py: using RAC 238 16:43:40.016852 tst iperf3.py: using CellId 34918 16:43:40.147871 tst iperf3.py: using BVCI 34919 16:43:40.269738 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:40.281300 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:40.292643 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:40.303984 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:40.315715 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:40.327432 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:40.339457 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:40.351152 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:40.363097 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:43:40.482604 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:43:40.693685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:43:41.008153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7228): Launched 16:43:41.282287 run iperf3-srv_10.42.42.10(pid=7229): Launched 16:43:41.402553 tst iperf3.py:8: start network... 16:43:41.612588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:42.099087 run create_hlr_db(pid=7230): Launched 16:43:42.229652 bus /gobi_6: Setting Powered False 16:43:43.295215 run create_hlr_db(pid=7230): Terminated: ok {rc=0} 16:43:43.759991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7232): Launched 16:43:44.096356 run osmo-hlr_10.42.42.2(pid=7233): Launched 16:43:44.225903 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:44.802829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7235): Launched 16:43:45.138941 run osmo-stp_10.42.42.5(pid=7236): Launched 16:43:45.267699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:43:45.849911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7238): Launched 16:43:45.994070 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:43:46.281756 run patchelf(pid=7239): Launched 16:43:46.517388 run osmo-stp_10.42.42.5(pid=7236): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7236)] 16:43:46.682905 run osmo-stp_10.42.42.5(pid=7236): stdout: | (launched: 2022-12-13_16:43:45.077580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:46.831604 run osmo-stp_10.42.42.5(pid=7236): stderr: | [0;m[38;5;43m20221213164345272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164345272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164345272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164345272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164345273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164345273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164345273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:46.980119 run osmo-stp_10.42.42.5(pid=7236): stdout: | (launched: 2022-12-13_16:43:45.077580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:47.121637 run osmo-stp_10.42.42.5(pid=7236): stderr: | [0;m[38;5;43m20221213164345272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164345272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164345272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164345272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164345273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164345273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164345273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:47.287099 run patchelf(pid=7239): Terminating (SIGINT) 16:43:47.474436 run patchelf(pid=7239): Terminated: ok {rc=0} 16:43:47.609982 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7236): Process ended prematurely: osmo-stp_10.42.42.5(pid=7236) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7236)] [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 16:43:47.620754 tst iperf3.py:8: Test FAILED (8.0 sec) 16:43:47.650365 run osmo-hlr_10.42.42.2(pid=7233): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7233)] 16:43:47.702217 run osmo-hlr_10.42.42.2(pid=7233): stdout: | (launched: 2022-12-13_16:43:44.034999) 16:43:47.755652 run osmo-hlr_10.42.42.2(pid=7233): stderr: | [0;m[1;31m20221213164344235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164344235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164344235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164344236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164344236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164344236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164344251 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164344261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164344261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164344261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:47.808912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7228): Terminating (SIGTERM) 16:43:47.851332 run iperf3-srv_10.42.42.10(pid=7229): Terminating (SIGTERM) 16:43:47.894404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7232): Terminating (SIGTERM) 16:43:47.937401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7235): Terminating (SIGTERM) 16:43:47.980110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7238): Terminating (SIGTERM) 16:43:48.023376 --- ParallelTerminationStrategy: PID 7228 died... 16:43:48.044185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7228): Terminated: ok {rc=0} 16:43:48.091333 --- ParallelTerminationStrategy: PID 7229 died... 16:43:48.111529 run iperf3-srv_10.42.42.10(pid=7229): Terminated {rc=256} 16:43:48.158147 --- ParallelTerminationStrategy: PID 7232 died... 16:43:48.178416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7232): Terminated: ok {rc=0} 16:43:48.225334 --- ParallelTerminationStrategy: PID 7235 died... 16:43:48.245316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7235): Terminated: ok {rc=0} 16:43:48.292099 --- ParallelTerminationStrategy: PID 7238 died... 16:43:48.312408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7238): Terminated: ok {rc=0} 16:43:48.401284 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:43:49.552720 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:49.565356 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:43:49.608851 tst iperf3m4.py: using LAC 34919 16:43:49.732266 tst iperf3m4.py: using RAC 239 16:43:49.861459 tst iperf3m4.py: using CellId 34919 16:43:49.988164 tst iperf3m4.py: using BVCI 34920 16:43:50.101708 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:50.112740 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:50.123849 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:50.134708 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:50.145631 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:50.156448 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:50.167580 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:50.178437 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:43:50.189533 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:43:50.312826 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:43:50.433460 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:43:50.556162 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:43:50.680034 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:43:50.905609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:43:51.242032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7240): Launched 16:43:51.535545 run iperf3-srv_10.42.42.10(pid=7241): Launched 16:43:51.663958 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:43:51.888942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:43:52.225536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7242): Launched 16:43:52.516864 run iperf3-srv_10.42.42.10(pid=7243): Launched 16:43:52.644550 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:43:52.869488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:43:53.206070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7244): Launched 16:43:53.497548 run iperf3-srv_10.42.42.10(pid=7245): Launched 16:43:53.623483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:43:53.848109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:43:54.183748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7246): Launched 16:43:54.474950 run iperf3-srv_10.42.42.10(pid=7247): Launched 16:43:54.600064 tst iperf3m4.py:8: start network... 16:43:54.825134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:55.343468 run create_hlr_db(pid=7248): Launched 16:43:55.472783 bus /gobi_6: Setting Powered False 16:43:56.538866 run create_hlr_db(pid=7248): Terminated: ok {rc=0} 16:43:57.003654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7250): Launched 16:43:57.338880 run osmo-hlr_10.42.42.2(pid=7251): Launched 16:43:57.467790 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:58.048081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7253): Launched 16:43:58.384619 run osmo-stp_10.42.42.5(pid=7254): Launched 16:43:58.512363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:43:59.088699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7256): Launched 16:43:59.219106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:43:59.502017 run patchelf(pid=7257): Launched 16:43:59.688514 run osmo-stp_10.42.42.5(pid=7254): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7254)] 16:43:59.829035 run osmo-stp_10.42.42.5(pid=7254): stdout: | (launched: 2022-12-13_16:43:58.322585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:59.972035 run osmo-stp_10.42.42.5(pid=7254): stderr: | [0;m[38;5;43m20221213164358513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164358513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164358513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164358513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164358514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164358514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164358514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:00.115855 run osmo-stp_10.42.42.5(pid=7254): stdout: | (launched: 2022-12-13_16:43:58.322585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:00.252527 run osmo-stp_10.42.42.5(pid=7254): stderr: | [0;m[38;5;43m20221213164358513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164358513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164358513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164358513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164358514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164358514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164358514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:00.414567 run patchelf(pid=7257): Terminating (SIGINT) 16:44:00.602994 run patchelf(pid=7257): Terminated: ok {rc=0} 16:44:00.738912 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7254): Process ended prematurely: osmo-stp_10.42.42.5(pid=7254) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7254)] [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 16:44:00.749496 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:44:00.778894 run osmo-hlr_10.42.42.2(pid=7251): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7251)] 16:44:00.830608 run osmo-hlr_10.42.42.2(pid=7251): stdout: | (launched: 2022-12-13_16:43:57.277016) 16:44:00.884237 run osmo-hlr_10.42.42.2(pid=7251): stderr: | [0;m[1;31m20221213164357475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164357475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164357475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164357476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164357476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164357476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164357489 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164357497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164357498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164357498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:00.938646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7240): Terminating (SIGTERM) 16:44:00.981778 run iperf3-srv_10.42.42.10(pid=7241): Terminating (SIGTERM) 16:44:01.026302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7242): Terminating (SIGTERM) 16:44:01.070749 run iperf3-srv_10.42.42.10(pid=7243): Terminating (SIGTERM) 16:44:01.117103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7244): Terminating (SIGTERM) 16:44:01.161045 run iperf3-srv_10.42.42.10(pid=7245): Terminating (SIGTERM) 16:44:01.204288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7246): Terminating (SIGTERM) 16:44:01.247685 run iperf3-srv_10.42.42.10(pid=7247): Terminating (SIGTERM) 16:44:01.290992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7250): Terminating (SIGTERM) 16:44:01.334508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7253): Terminating (SIGTERM) 16:44:01.378095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7256): Terminating (SIGTERM) 16:44:01.424042 --- ParallelTerminationStrategy: PID 7240 died... 16:44:01.444720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7240): Terminated: ok {rc=0} 16:44:01.492599 --- ParallelTerminationStrategy: PID 7241 died... 16:44:01.513168 run iperf3-srv_10.42.42.10(pid=7241): Terminated {rc=256} 16:44:01.560691 --- ParallelTerminationStrategy: PID 7242 died... 16:44:01.581350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7242): Terminated: ok {rc=0} 16:44:01.629288 --- ParallelTerminationStrategy: PID 7243 died... 16:44:01.649722 run iperf3-srv_10.42.42.10(pid=7243): Terminated {rc=256} 16:44:01.697401 --- ParallelTerminationStrategy: PID 7244 died... 16:44:01.718045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7244): Terminated: ok {rc=0} 16:44:01.765867 --- ParallelTerminationStrategy: PID 7245 died... 16:44:01.786448 run iperf3-srv_10.42.42.10(pid=7245): Terminated {rc=256} 16:44:01.833869 --- ParallelTerminationStrategy: PID 7246 died... 16:44:01.854523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7246): Terminated: ok {rc=0} 16:44:01.902188 --- ParallelTerminationStrategy: PID 7247 died... 16:44:01.922653 run iperf3-srv_10.42.42.10(pid=7247): Terminated {rc=256} 16:44:01.970057 --- ParallelTerminationStrategy: PID 7250 died... 16:44:01.990810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7250): Terminated: ok {rc=0} 16:44:02.038821 --- ParallelTerminationStrategy: PID 7253 died... 16:44:02.059622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7253): Terminated: ok {rc=0} 16:44:02.107204 --- ParallelTerminationStrategy: PID 7256 died... 16:44:02.127961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7256): Terminated: ok {rc=0} 16:44:02.219578 bus /gobi_4: Setting Powered False 16:44:03.318048 bus /gobi_4: Setting Powered False 16:44:04.434644 bus /gobi_1: Setting Powered False 16:44:05.534210 bus /gobi_1: Setting Powered False 16:44:06.650016 bus /gobi_0: Setting Powered False 16:44:07.749783 bus /gobi_0: Setting Powered False 16:44:08.865619 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 16:44:09.968718 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:09.981420 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:44:10.025166 tst ping.py: using LAC 34920 16:44:10.155593 tst ping.py: using RAC 240 16:44:10.283099 tst ping.py: using CellId 34920 16:44:10.412652 tst ping.py: using BVCI 34921 16:44:10.531422 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:10.543089 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:10.554718 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:10.566254 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:10.577949 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:10.589982 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:10.602007 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:10.613865 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:44:10.733875 tst ping.py:19: start network... 16:44:10.938966 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:11.413190 run create_hlr_db(pid=7258): Launched 16:44:11.540149 bus /gobi_6: Setting Powered False 16:44:12.601540 run create_hlr_db(pid=7258): Terminated: ok {rc=0} 16:44:13.051090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7260): Launched 16:44:13.379148 run osmo-hlr_10.42.42.2(pid=7261): Launched 16:44:13.505680 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:14.071980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7263): Launched 16:44:14.402873 run osmo-stp_10.42.42.5(pid=7264): Launched 16:44:14.529403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:44:15.094987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7266): Launched 16:44:15.222029 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:44:15.499416 run patchelf(pid=7267): Launched 16:44:15.684184 run osmo-stp_10.42.42.5(pid=7264): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7264)] 16:44:15.822875 run osmo-stp_10.42.42.5(pid=7264): stdout: | (launched: 2022-12-13_16:44:14.342205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:15.979417 run osmo-stp_10.42.42.5(pid=7264): stderr: | [0;m[38;5;43m20221213164414534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164414534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164414534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164414534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164414535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164414535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164414535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:16.116721 run osmo-stp_10.42.42.5(pid=7264): stdout: | (launched: 2022-12-13_16:44:14.342205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:16.246696 run osmo-stp_10.42.42.5(pid=7264): stderr: | [0;m[38;5;43m20221213164414534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164414534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164414534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164414534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164414535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164414535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164414535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:16.400094 run patchelf(pid=7267): Terminating (SIGINT) 16:44:16.579134 run patchelf(pid=7267): Terminated: ok {rc=0} 16:44:16.707854 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7264): Process ended prematurely: osmo-stp_10.42.42.5(pid=7264) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7264)] [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 16:44:16.717724 tst ping.py:22: Test FAILED (6.7 sec) 16:44:16.746153 run osmo-hlr_10.42.42.2(pid=7261): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7261)] 16:44:16.798038 run osmo-hlr_10.42.42.2(pid=7261): stdout: | (launched: 2022-12-13_16:44:13.318499) 16:44:16.850170 run osmo-hlr_10.42.42.2(pid=7261): stderr: | [0;m[1;31m20221213164413518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164413518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164413518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164413518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164413518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164413518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164413531 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164413539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164413540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164413540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:16.902720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7260): Terminating (SIGTERM) 16:44:16.945286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7263): Terminating (SIGTERM) 16:44:16.989719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7266): Terminating (SIGTERM) 16:44:17.033603 --- ParallelTerminationStrategy: PID 7260 died... 16:44:17.053753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7260): Terminated: ok {rc=0} 16:44:17.100919 --- ParallelTerminationStrategy: PID 7263 died... 16:44:17.120714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7263): Terminated: ok {rc=0} 16:44:17.167449 --- ParallelTerminationStrategy: PID 7266 died... 16:44:17.187462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7266): Terminated: ok {rc=0} 16:44:17.275218 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:44:18.365403 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:18.377875 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:44:18.421246 tst ping_idle_ping.py: using LAC 34921 16:44:18.542894 tst ping_idle_ping.py: using RAC 241 16:44:18.663979 tst ping_idle_ping.py: using CellId 34921 16:44:18.785963 tst ping_idle_ping.py: using BVCI 34922 16:44:18.899487 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:18.910717 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:18.921784 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:18.932679 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:18.943578 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:18.954470 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:18.965694 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:44:18.976600 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:44:19.097259 tst ping_idle_ping.py:24: start network... 16:44:19.318021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:19.833992 run create_hlr_db(pid=7268): Launched 16:44:19.961452 bus /gobi_6: Setting Powered False 16:44:21.026452 run create_hlr_db(pid=7268): Terminated: ok {rc=0} 16:44:21.466163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7270): Launched 16:44:21.776457 run osmo-hlr_10.42.42.2(pid=7271): Launched 16:44:21.894349 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:22.445989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7273): Launched 16:44:22.755364 run osmo-stp_10.42.42.5(pid=7274): Launched 16:44:22.872538 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:44:23.402711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7276): Launched 16:44:23.520611 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:44:23.781925 run patchelf(pid=7277): Launched 16:44:23.953996 run osmo-stp_10.42.42.5(pid=7274): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7274)] 16:44:24.084617 run osmo-stp_10.42.42.5(pid=7274): stdout: | (launched: 2022-12-13_16:44:22.697851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:24.217761 run osmo-stp_10.42.42.5(pid=7274): stderr: | [0;m[38;5;43m20221213164422873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164422873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164422873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164422873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164422874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164422874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164422874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:24.350840 run osmo-stp_10.42.42.5(pid=7274): stdout: | (launched: 2022-12-13_16:44:22.697851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:24.476835 run osmo-stp_10.42.42.5(pid=7274): stderr: | [0;m[38;5;43m20221213164422873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164422873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164422873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164422873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164422874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164422874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164422874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:24.626166 run patchelf(pid=7277): Terminating (SIGINT) 16:44:24.799846 run patchelf(pid=7277): Terminated: ok {rc=0} 16:44:24.924908 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7274): Process ended prematurely: osmo-stp_10.42.42.5(pid=7274) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7274)] [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 16:44:24.934251 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:44:24.961373 run osmo-hlr_10.42.42.2(pid=7271): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7271)] 16:44:25.009623 run osmo-hlr_10.42.42.2(pid=7271): stdout: | (launched: 2022-12-13_16:44:21.719153) 16:44:25.058820 run osmo-hlr_10.42.42.2(pid=7271): stderr: | [0;m[1;31m20221213164421899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164421899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164421899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164421899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164421899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164421899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164421912 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164421921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164421921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164421921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:25.108540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7270): Terminating (SIGTERM) 16:44:25.148725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7273): Terminating (SIGTERM) 16:44:25.188650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7276): Terminating (SIGTERM) 16:44:25.228842 --- ParallelTerminationStrategy: PID 7270 died... 16:44:25.248252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7270): Terminated: ok {rc=0} 16:44:25.292874 --- ParallelTerminationStrategy: PID 7273 died... 16:44:25.312263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7273): Terminated: ok {rc=0} 16:44:25.356214 --- ParallelTerminationStrategy: PID 7276 died... 16:44:25.374967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7276): Terminated: ok {rc=0} 16:44:25.458459 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:44:26.759658 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:44:26.767416 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:44:26.792119 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:44:26.835525 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:44:26.926642 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:44:26.951327 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:44:26.991939 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:44:27.590682 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:44:27.646045 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:27.657666 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:44:27.721389 tst cs_paging_gprs_active.py: using LAC 34922 16:44:27.851030 tst cs_paging_gprs_active.py: using RAC 242 16:44:27.982717 tst cs_paging_gprs_active.py: using CellId 34922 16:44:28.113888 tst cs_paging_gprs_active.py: using BVCI 34923 16:44:28.236265 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:28.248017 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:28.259459 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:28.270944 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:28.282712 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:28.294409 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:28.306254 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:28.317933 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:28.329811 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:44:28.456781 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:44:28.580721 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:44:28.808185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:44:29.143625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7284): Launched 16:44:29.435498 run iperf3-srv_10.42.42.10(pid=7285): Launched 16:44:29.562247 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:44:29.787958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:44:30.124168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7286): Launched 16:44:30.417844 run iperf3-srv_10.42.42.10(pid=7287): Launched 16:44:30.543294 tst cs_paging_gprs_active.py:38: start network... 16:44:30.769371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:31.317905 run create_hlr_db(pid=7288): Launched 16:44:31.513374 bus /gobi_6: Setting Powered False 16:44:32.575575 run create_hlr_db(pid=7288): Terminated: ok {rc=0} 16:44:33.064102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7290): Launched 16:44:33.379379 run osmo-hlr_10.42.42.2(pid=7291): Launched 16:44:33.500556 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:34.040500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7293): Launched 16:44:34.355593 run osmo-stp_10.42.42.5(pid=7294): Launched 16:44:34.475869 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:44:35.016549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7296): Launched 16:44:35.137680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:44:35.404134 run patchelf(pid=7297): Launched 16:44:35.580596 run osmo-stp_10.42.42.5(pid=7294): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7294)] 16:44:35.713588 run osmo-stp_10.42.42.5(pid=7294): stdout: | (launched: 2022-12-13_16:44:34.297347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:35.847609 run osmo-stp_10.42.42.5(pid=7294): stderr: | [0;m[38;5;43m20221213164434468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164434468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164434468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164434469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164434469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164434469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164434469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:35.981822 run osmo-stp_10.42.42.5(pid=7294): stdout: | (launched: 2022-12-13_16:44:34.297347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:36.109902 run osmo-stp_10.42.42.5(pid=7294): stderr: | [0;m[38;5;43m20221213164434468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164434468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164434468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164434469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164434469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164434469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164434469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:36.261652 run patchelf(pid=7297): Terminating (SIGINT) 16:44:36.438681 run patchelf(pid=7297): Terminated: ok {rc=0} 16:44:36.565653 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7294): Process ended prematurely: osmo-stp_10.42.42.5(pid=7294) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7294)] [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:44:36.575351 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:44:36.603171 run osmo-hlr_10.42.42.2(pid=7291): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7291)] 16:44:36.651386 run osmo-hlr_10.42.42.2(pid=7291): stdout: | (launched: 2022-12-13_16:44:33.321326) 16:44:36.701360 run osmo-hlr_10.42.42.2(pid=7291): stderr: | [0;m[1;31m20221213164433499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164433499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164433499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164433499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164433499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164433499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164433511 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164433520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164433521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164433521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:36.751960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7284): Terminating (SIGTERM) 16:44:36.792044 run iperf3-srv_10.42.42.10(pid=7285): Terminating (SIGTERM) 16:44:36.832146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7286): Terminating (SIGTERM) 16:44:36.872190 run iperf3-srv_10.42.42.10(pid=7287): Terminating (SIGTERM) 16:44:36.912127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7290): Terminating (SIGTERM) 16:44:36.952221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7293): Terminating (SIGTERM) 16:44:36.992497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7296): Terminating (SIGTERM) 16:44:37.032809 --- ParallelTerminationStrategy: PID 7284 died... 16:44:37.052258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7284): Terminated: ok {rc=0} 16:44:37.097291 --- ParallelTerminationStrategy: PID 7285 died... 16:44:37.116044 run iperf3-srv_10.42.42.10(pid=7285): Terminated {rc=256} 16:44:37.160180 --- ParallelTerminationStrategy: PID 7286 died... 16:44:37.179049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7286): Terminated: ok {rc=0} 16:44:37.223112 --- ParallelTerminationStrategy: PID 7287 died... 16:44:37.241811 run iperf3-srv_10.42.42.10(pid=7287): Terminated {rc=256} 16:44:37.285856 --- ParallelTerminationStrategy: PID 7290 died... 16:44:37.304653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7290): Terminated: ok {rc=0} 16:44:37.348859 --- ParallelTerminationStrategy: PID 7293 died... 16:44:37.368271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7293): Terminated: ok {rc=0} 16:44:37.412559 --- ParallelTerminationStrategy: PID 7296 died... 16:44:37.431401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7296): Terminated: ok {rc=0} 16:44:37.515084 bus /gobi_0: Setting Powered False 16:44:38.614115 bus /gobi_0: Setting Powered False 16:44:39.733901 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:44:40.881500 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:40.893537 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:44:40.956910 tst iperf3.py: using LAC 34923 16:44:41.078955 tst iperf3.py: using RAC 243 16:44:41.202862 tst iperf3.py: using CellId 34923 16:44:41.326871 tst iperf3.py: using BVCI 34924 16:44:41.441722 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:41.452775 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:41.463829 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:41.474747 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:41.485604 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:41.496545 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:41.507569 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:41.518502 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:41.529560 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:44:41.645532 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:44:41.854425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:44:42.169511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7298): Launched 16:44:42.443445 run iperf3-srv_10.42.42.10(pid=7299): Launched 16:44:42.561126 tst iperf3.py:8: start network... 16:44:42.770118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:43.253680 run create_hlr_db(pid=7300): Launched 16:44:43.381161 bus /gobi_6: Setting Powered False 16:44:44.443530 run create_hlr_db(pid=7300): Terminated: ok {rc=0} 16:44:44.898679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7302): Launched 16:44:45.233930 run osmo-hlr_10.42.42.2(pid=7303): Launched 16:44:45.362721 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:45.951292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7305): Launched 16:44:46.287433 run osmo-stp_10.42.42.5(pid=7306): Launched 16:44:46.532902 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:44:47.243007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7308): Launched 16:44:47.364806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:44:47.630266 run patchelf(pid=7309): Launched 16:44:47.804683 run osmo-stp_10.42.42.5(pid=7306): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7306)] 16:44:47.936901 run osmo-stp_10.42.42.5(pid=7306): stdout: | (launched: 2022-12-13_16:44:46.227910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:48.071373 run osmo-stp_10.42.42.5(pid=7306): stderr: | [0;m[38;5;43m20221213164446554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164446554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164446554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164446554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164446555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164446555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164446555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:48.205173 run osmo-stp_10.42.42.5(pid=7306): stdout: | (launched: 2022-12-13_16:44:46.227910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:48.332780 run osmo-stp_10.42.42.5(pid=7306): stderr: | [0;m[38;5;43m20221213164446554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164446554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164446554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164446554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164446555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164446555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164446555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:48.485504 run patchelf(pid=7309): Terminating (SIGINT) 16:44:48.661521 run patchelf(pid=7309): Terminated: ok {rc=0} 16:44:48.788171 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7306): Process ended prematurely: osmo-stp_10.42.42.5(pid=7306) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7306)] [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 16:44:48.797882 tst iperf3.py:8: Test FAILED (8.0 sec) 16:44:48.825482 run osmo-hlr_10.42.42.2(pid=7303): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7303)] 16:44:48.873509 run osmo-hlr_10.42.42.2(pid=7303): stdout: | (launched: 2022-12-13_16:44:45.172146) 16:44:48.923275 run osmo-hlr_10.42.42.2(pid=7303): stderr: | [0;m[1;31m20221213164445372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164445372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164445373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164445373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164445373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164445373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164445386 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164445395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164445395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164445395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:48.973174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7298): Terminating (SIGTERM) 16:44:49.013416 run iperf3-srv_10.42.42.10(pid=7299): Terminating (SIGTERM) 16:44:49.053358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7302): Terminating (SIGTERM) 16:44:49.093416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7305): Terminating (SIGTERM) 16:44:49.133349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7308): Terminating (SIGTERM) 16:44:49.173842 --- ParallelTerminationStrategy: PID 7298 died... 16:44:49.193147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7298): Terminated: ok {rc=0} 16:44:49.237362 --- ParallelTerminationStrategy: PID 7299 died... 16:44:49.256136 run iperf3-srv_10.42.42.10(pid=7299): Terminated {rc=256} 16:44:49.300167 --- ParallelTerminationStrategy: PID 7302 died... 16:44:49.318900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7302): Terminated: ok {rc=0} 16:44:49.363403 --- ParallelTerminationStrategy: PID 7305 died... 16:44:49.382745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7305): Terminated: ok {rc=0} 16:44:49.427118 --- ParallelTerminationStrategy: PID 7308 died... 16:44:49.445955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7308): Terminated: ok {rc=0} 16:44:49.532289 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:44:50.681144 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:50.692888 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:44:50.754566 tst iperf3m4.py: using LAC 34924 16:44:50.877445 tst iperf3m4.py: using RAC 244 16:44:50.999427 tst iperf3m4.py: using CellId 34924 16:44:51.123494 tst iperf3m4.py: using BVCI 34925 16:44:51.238462 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:51.249700 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:51.260651 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:51.271572 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:51.282517 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:51.293458 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:51.304436 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:51.315401 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:44:51.326463 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:44:51.452091 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:44:51.573927 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:44:51.696196 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:44:51.815808 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:44:52.025179 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:44:52.338671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7310): Launched 16:44:52.615131 run iperf3-srv_10.42.42.10(pid=7311): Launched 16:44:52.734556 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:44:52.943724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:44:53.258407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7312): Launched 16:44:53.533464 run iperf3-srv_10.42.42.10(pid=7313): Launched 16:44:53.650766 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:44:53.858897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:44:54.173483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7314): Launched 16:44:54.446354 run iperf3-srv_10.42.42.10(pid=7315): Launched 16:44:54.565993 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:44:54.775067 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:44:55.089291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7316): Launched 16:44:55.365483 run iperf3-srv_10.42.42.10(pid=7317): Launched 16:44:55.484470 tst iperf3m4.py:8: start network... 16:44:55.692669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:56.175659 run create_hlr_db(pid=7318): Launched 16:44:56.303665 bus /gobi_6: Setting Powered False 16:44:57.366531 run create_hlr_db(pid=7318): Terminated: ok {rc=0} 16:44:57.822600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7320): Launched 16:44:58.159789 run osmo-hlr_10.42.42.2(pid=7321): Launched 16:44:58.287460 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:58.862388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7323): Launched 16:44:59.198178 run osmo-stp_10.42.42.5(pid=7324): Launched 16:44:59.326008 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:44:59.902678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7326): Launched 16:45:00.031120 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:45:00.314620 run patchelf(pid=7327): Launched 16:45:00.501035 run osmo-stp_10.42.42.5(pid=7324): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7324)] 16:45:00.642501 run osmo-stp_10.42.42.5(pid=7324): stdout: | (launched: 2022-12-13_16:44:59.136487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:00.785411 run osmo-stp_10.42.42.5(pid=7324): stderr: | [0;m[38;5;43m20221213164459327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164459327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164459327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164459328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164459328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164459328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164459328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:00.950594 run osmo-stp_10.42.42.5(pid=7324): stdout: | (launched: 2022-12-13_16:44:59.136487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:01.083013 run osmo-stp_10.42.42.5(pid=7324): stderr: | [0;m[38;5;43m20221213164459327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164459327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164459327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164459328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164459328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164459328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164459328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:01.238495 run patchelf(pid=7327): Terminating (SIGINT) 16:45:01.422729 run patchelf(pid=7327): Terminated: ok {rc=0} 16:45:01.552307 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7324): Process ended prematurely: osmo-stp_10.42.42.5(pid=7324) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7324)] [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:45:01.564625 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:45:01.593874 run osmo-hlr_10.42.42.2(pid=7321): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7321)] 16:45:01.643837 run osmo-hlr_10.42.42.2(pid=7321): stdout: | (launched: 2022-12-13_16:44:58.097856) 16:45:01.695421 run osmo-hlr_10.42.42.2(pid=7321): stderr: | [0;m[1;31m20221213164458297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164458297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164458297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164458298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164458298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164458298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164458310 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164458319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164458319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164458319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:01.746789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7310): Terminating (SIGTERM) 16:45:01.802152 run iperf3-srv_10.42.42.10(pid=7311): Terminating (SIGTERM) 16:45:01.844470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7312): Terminating (SIGTERM) 16:45:01.886775 run iperf3-srv_10.42.42.10(pid=7313): Terminating (SIGTERM) 16:45:01.928201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7314): Terminating (SIGTERM) 16:45:01.970659 run iperf3-srv_10.42.42.10(pid=7315): Terminating (SIGTERM) 16:45:02.011823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7316): Terminating (SIGTERM) 16:45:02.052929 run iperf3-srv_10.42.42.10(pid=7317): Terminating (SIGTERM) 16:45:02.094476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7320): Terminating (SIGTERM) 16:45:02.136310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7323): Terminating (SIGTERM) 16:45:02.180428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7326): Terminating (SIGTERM) 16:45:02.224812 --- ParallelTerminationStrategy: PID 7310 died... 16:45:02.244511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7310): Terminated: ok {rc=0} 16:45:02.289526 --- ParallelTerminationStrategy: PID 7311 died... 16:45:02.308392 run iperf3-srv_10.42.42.10(pid=7311): Terminated {rc=256} 16:45:02.352792 --- ParallelTerminationStrategy: PID 7312 died... 16:45:02.371668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7312): Terminated: ok {rc=0} 16:45:02.415966 --- ParallelTerminationStrategy: PID 7313 died... 16:45:02.434975 run iperf3-srv_10.42.42.10(pid=7313): Terminated {rc=256} 16:45:02.479346 --- ParallelTerminationStrategy: PID 7314 died... 16:45:02.498234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7314): Terminated: ok {rc=0} 16:45:02.543216 --- ParallelTerminationStrategy: PID 7315 died... 16:45:02.562232 run iperf3-srv_10.42.42.10(pid=7315): Terminated {rc=256} 16:45:02.606675 --- ParallelTerminationStrategy: PID 7316 died... 16:45:02.625756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7316): Terminated: ok {rc=0} 16:45:02.670184 --- ParallelTerminationStrategy: PID 7317 died... 16:45:02.689159 run iperf3-srv_10.42.42.10(pid=7317): Terminated {rc=256} 16:45:02.733597 --- ParallelTerminationStrategy: PID 7320 died... 16:45:02.752449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7320): Terminated: ok {rc=0} 16:45:02.796757 --- ParallelTerminationStrategy: PID 7323 died... 16:45:02.815835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7323): Terminated: ok {rc=0} 16:45:02.860504 --- ParallelTerminationStrategy: PID 7326 died... 16:45:02.879717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7326): Terminated: ok {rc=0} 16:45:02.967224 bus /gobi_4: Setting Powered False 16:45:04.068369 bus /gobi_4: Setting Powered False 16:45:05.183052 bus /gobi_1: Setting Powered False 16:45:06.282922 bus /gobi_1: Setting Powered False 16:45:07.402121 bus /gobi_0: Setting Powered False 16:45:08.503833 bus /gobi_0: Setting Powered False 16:45:09.620822 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:45:10.723698 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:10.736401 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:45:10.800827 tst ping.py: using LAC 34925 16:45:10.928378 tst ping.py: using RAC 245 16:45:11.057619 tst ping.py: using CellId 34925 16:45:11.180612 tst ping.py: using BVCI 34926 16:45:11.292896 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:11.304307 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:11.315535 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:11.326622 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:11.337509 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:11.348473 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:11.359562 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:11.370526 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:45:11.492006 tst ping.py:19: start network... 16:45:11.712942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:12.218915 run create_hlr_db(pid=7331): Launched 16:45:12.345605 bus /gobi_6: Setting Powered False 16:45:13.410382 run create_hlr_db(pid=7331): Terminated: ok {rc=0} 16:45:13.849112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7333): Launched 16:45:14.156790 run osmo-hlr_10.42.42.2(pid=7334): Launched 16:45:14.274338 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:14.817640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7336): Launched 16:45:15.126023 run osmo-stp_10.42.42.5(pid=7337): Launched 16:45:15.243369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:45:15.774600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7339): Launched 16:45:15.899902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:45:16.168213 run patchelf(pid=7340): Launched 16:45:16.364167 run osmo-stp_10.42.42.5(pid=7337): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7337)] 16:45:16.531886 run osmo-stp_10.42.42.5(pid=7337): stdout: | (launched: 2022-12-13_16:45:15.068618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:16.705958 run osmo-stp_10.42.42.5(pid=7337): stderr: | [0;m[38;5;43m20221213164515241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164515241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164515242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164515242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164515242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164515242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164515243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:16.855823 run osmo-stp_10.42.42.5(pid=7337): stdout: | (launched: 2022-12-13_16:45:15.068618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:16.995823 run osmo-stp_10.42.42.5(pid=7337): stderr: | [0;m[38;5;43m20221213164515241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164515241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164515242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164515242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164515242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164515242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164515243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:17.158918 run patchelf(pid=7340): Terminating (SIGINT) 16:45:17.347744 run patchelf(pid=7340): Terminated: ok {rc=0} 16:45:17.481067 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7337): Process ended prematurely: osmo-stp_10.42.42.5(pid=7337) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7337)] [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 16:45:17.490916 tst ping.py:22: Test FAILED (6.8 sec) 16:45:17.519318 run osmo-hlr_10.42.42.2(pid=7334): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7334)] 16:45:17.571691 run osmo-hlr_10.42.42.2(pid=7334): stdout: | (launched: 2022-12-13_16:45:14.099556) 16:45:17.624320 run osmo-hlr_10.42.42.2(pid=7334): stderr: | [0;m[1;31m20221213164514278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164514278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164514278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164514278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164514278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164514278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164514290 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164514298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164514299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164514299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:17.677730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7333): Terminating (SIGTERM) 16:45:17.720428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7336): Terminating (SIGTERM) 16:45:17.762883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7339): Terminating (SIGTERM) 16:45:17.806412 --- ParallelTerminationStrategy: PID 7333 died... 16:45:17.827329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7333): Terminated: ok {rc=0} 16:45:17.874438 --- ParallelTerminationStrategy: PID 7336 died... 16:45:17.894911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7336): Terminated: ok {rc=0} 16:45:17.942165 --- ParallelTerminationStrategy: PID 7339 died... 16:45:17.962603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7339): Terminated: ok {rc=0} 16:45:18.052267 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:45:19.140063 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:19.152480 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:45:19.221431 tst ping_idle_ping.py: using LAC 34926 16:45:19.348520 tst ping_idle_ping.py: using RAC 246 16:45:19.472855 tst ping_idle_ping.py: using CellId 34926 16:45:19.595926 tst ping_idle_ping.py: using BVCI 34927 16:45:19.706690 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:19.718176 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:19.729318 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:19.740373 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:19.751501 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:19.762598 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:19.773847 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:45:19.784808 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:45:19.906741 tst ping_idle_ping.py:24: start network... 16:45:20.127057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:20.635621 run create_hlr_db(pid=7341): Launched 16:45:20.763107 bus /gobi_6: Setting Powered False 16:45:21.827393 run create_hlr_db(pid=7341): Terminated: ok {rc=0} 16:45:22.267579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7343): Launched 16:45:22.577296 run osmo-hlr_10.42.42.2(pid=7344): Launched 16:45:22.698720 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:23.226308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7346): Launched 16:45:23.533036 run osmo-stp_10.42.42.5(pid=7347): Launched 16:45:23.650960 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:45:24.181064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7349): Launched 16:45:24.298454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:45:24.558973 run patchelf(pid=7350): Launched 16:45:24.732707 run osmo-stp_10.42.42.5(pid=7347): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7347)] 16:45:24.862469 run osmo-stp_10.42.42.5(pid=7347): stdout: | (launched: 2022-12-13_16:45:23.475933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:24.993962 run osmo-stp_10.42.42.5(pid=7347): stderr: | [0;m[38;5;43m20221213164523648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164523648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164523648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164523649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164523649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164523649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164523649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:25.125853 run osmo-stp_10.42.42.5(pid=7347): stdout: | (launched: 2022-12-13_16:45:23.475933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:25.250652 run osmo-stp_10.42.42.5(pid=7347): stderr: | [0;m[38;5;43m20221213164523648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164523648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164523648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164523649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164523649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164523649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164523649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:25.399417 run patchelf(pid=7350): Terminating (SIGINT) 16:45:25.571629 run patchelf(pid=7350): Terminated: ok {rc=0} 16:45:25.695755 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7347): Process ended prematurely: osmo-stp_10.42.42.5(pid=7347) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7347)] [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:45:25.704870 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:45:25.731818 run osmo-hlr_10.42.42.2(pid=7344): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7344)] 16:45:25.779956 run osmo-hlr_10.42.42.2(pid=7344): stdout: | (launched: 2022-12-13_16:45:22.519976) 16:45:25.829553 run osmo-hlr_10.42.42.2(pid=7344): stderr: | [0;m[1;31m20221213164522699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164522699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164522699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164522699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164522699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164522699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164522711 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164522719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164522719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164522719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:25.879654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7343): Terminating (SIGTERM) 16:45:25.919799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7346): Terminating (SIGTERM) 16:45:25.959924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7349): Terminating (SIGTERM) 16:45:26.000329 --- ParallelTerminationStrategy: PID 7343 died... 16:45:26.019857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7343): Terminated: ok {rc=0} 16:45:26.064336 --- ParallelTerminationStrategy: PID 7346 died... 16:45:26.083465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7346): Terminated: ok {rc=0} 16:45:26.127884 --- ParallelTerminationStrategy: PID 7349 died... 16:45:26.147112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7349): Terminated: ok {rc=0} 16:45:26.231622 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 16:45:27.534544 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:27.543318 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:45:27.568620 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:45:27.605814 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:45:27.660368 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:45:27.685327 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:45:27.721512 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:45:28.285257 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:45:28.291599 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:45:28.304240 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:45:28.370282 tst switch_tch_pdch.py: using LAC 34927 16:45:28.498321 tst switch_tch_pdch.py: using RAC 247 16:45:28.628032 tst switch_tch_pdch.py: using CellId 34927 16:45:28.756658 tst switch_tch_pdch.py: using BVCI 34928 16:45:28.877681 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:45:28.889884 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:45:28.902003 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:45:28.914130 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:45:28.927041 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:45:28.939787 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:45:28.952802 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:45:28.965744 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:45:29.085470 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:45:29.207465 tst switch_tch_pdch.py:51: start network... 16:45:29.428630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:29.935654 run create_hlr_db(pid=7354): Launched 16:45:30.062940 bus /gobi_6: Setting Powered False 16:45:31.122854 run create_hlr_db(pid=7354): Terminated: ok {rc=0} 16:45:31.572230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7356): Launched 16:45:31.901332 run osmo-hlr_10.42.42.2(pid=7357): Launched 16:45:32.177786 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:32.711863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7359): Launched 16:45:33.020241 run osmo-stp_10.42.42.5(pid=7360): Launched 16:45:33.137778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:45:33.666473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7362): Launched 16:45:33.785981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:45:34.046100 run patchelf(pid=7363): Launched 16:45:34.218372 run osmo-stp_10.42.42.5(pid=7360): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7360)] 16:45:34.347772 run osmo-stp_10.42.42.5(pid=7360): stdout: | (launched: 2022-12-13_16:45:32.963114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:34.479007 run osmo-stp_10.42.42.5(pid=7360): stderr: | [0;m[38;5;43m20221213164533133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164533133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164533133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164533134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164533134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164533134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164533134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:34.610330 run osmo-stp_10.42.42.5(pid=7360): stdout: | (launched: 2022-12-13_16:45:32.963114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:34.734974 run osmo-stp_10.42.42.5(pid=7360): stderr: | [0;m[38;5;43m20221213164533133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164533133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164533133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164533134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164533134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164533134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164533134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:34.883502 run patchelf(pid=7363): Terminating (SIGINT) 16:45:35.056007 run patchelf(pid=7363): Terminated: ok {rc=0} 16:45:35.179675 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7360): Process ended prematurely: osmo-stp_10.42.42.5(pid=7360) [trial-2391↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7360)] [trial-2391↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:45:35.188723 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 16:45:35.215538 run osmo-hlr_10.42.42.2(pid=7357): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7357)] 16:45:35.263684 run osmo-hlr_10.42.42.2(pid=7357): stdout: | (launched: 2022-12-13_16:45:31.842509) 16:45:35.313460 run osmo-hlr_10.42.42.2(pid=7357): stderr: | [0;m[1;31m20221213164532107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164532107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164532107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164532107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164532107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164532107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164532126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164532143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164532143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164532143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:35.363521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7356): Terminating (SIGTERM) 16:45:35.403754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7359): Terminating (SIGTERM) 16:45:35.443801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7362): Terminating (SIGTERM) 16:45:35.483973 --- ParallelTerminationStrategy: PID 7356 died... 16:45:35.503281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7356): Terminated: ok {rc=0} 16:45:35.547569 --- ParallelTerminationStrategy: PID 7359 died... 16:45:35.566342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7359): Terminated: ok {rc=0} 16:45:35.610087 --- ParallelTerminationStrategy: PID 7362 died... 16:45:35.628738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7362): Terminated: ok {rc=0} 16:45:35.715184 bus /gobi_0: Setting Powered False 16:45:36.815032 bus /gobi_0: Setting Powered False 16:45:37.932119 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 sms:nanobts+band-900 --------------------------------------------------------------------- 16:45:39.179245 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:39.184209 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:45:39.216396 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 16:45:39.243348 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 16:45:39.294963 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:45:39.327494 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 16:45:39.354410 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 16:45:39.902865 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 16:45:39.908132 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:39.918902 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 16:45:39.966608 tst mo_mt_sms.py: using LAC 34928 16:45:40.097830 tst mo_mt_sms.py: using RAC 248 16:45:40.229407 tst mo_mt_sms.py: using CellId 34928 16:45:40.356302 tst mo_mt_sms.py: using BVCI 34929 16:45:40.475072 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:40.486534 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:40.497887 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:40.509119 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:40.520704 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:40.532496 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 16:45:40.651271 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 16:45:40.767253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:41.242645 run create_hlr_db(pid=7367): Launched 16:45:41.370225 bus /gobi_6: Setting Powered False 16:45:42.431633 run create_hlr_db(pid=7367): Terminated: ok {rc=0} 16:45:42.879540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7369): Launched 16:45:43.208794 run osmo-hlr_10.42.42.2(pid=7370): Launched 16:45:43.335409 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:43.900069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7372): Launched 16:45:44.229035 run osmo-stp_10.42.42.5(pid=7373): Launched 16:45:44.354812 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:44.946767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7375): Launched 16:45:45.277691 run osmo-msc_10.42.42.6(pid=7376): Launched 16:45:45.462254 run osmo-stp_10.42.42.5(pid=7373): ERR: Terminated: ERROR {rc=1} [trial-2391↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7373)] 16:45:45.599945 run osmo-stp_10.42.42.5(pid=7373): stdout: | (launched: 2022-12-13_16:45:44.168579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:45.739574 run osmo-stp_10.42.42.5(pid=7373): stderr: | [0;m[38;5;43m20221213164544361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164544361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164544361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164544362 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164544362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164544362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164544362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:45.898154 run osmo-stp_10.42.42.5(pid=7373): stdout: | (launched: 2022-12-13_16:45:44.168579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:46.026019 run osmo-stp_10.42.42.5(pid=7373): stderr: | [0;m[38;5;43m20221213164544361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164544361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164544361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164544362 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164544362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164544362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164544362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:46.177253 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7373): Process ended prematurely: osmo-stp_10.42.42.5(pid=7373) [trial-2391↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7373)] [trial-2391↪sms:nanobts+band-900↪mo_mt_sms.py:16] 16:45:46.186788 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 16:45:46.214654 run osmo-hlr_10.42.42.2(pid=7370): ERR: Terminated: ERROR {rc=237} [trial-2391↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7370)] 16:45:46.264275 run osmo-hlr_10.42.42.2(pid=7370): stdout: | (launched: 2022-12-13_16:45:43.148487) 16:45:46.315024 run osmo-hlr_10.42.42.2(pid=7370): stderr: | [0;m[1;31m20221213164543346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164543346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164543346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164543346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164543346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164543346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164543364 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164543373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164543374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164543374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:46.386512 run osmo-msc_10.42.42.6(pid=7376): ERR: Terminated: ERROR {rc=2} [trial-2391↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7376)] 16:45:46.435887 run osmo-msc_10.42.42.6(pid=7376): stdout: | (launched: 2022-12-13_16:45:45.216756) 16:45:46.487151 run osmo-msc_10.42.42.6(pid=7376): stderr: | [0;m[38;5;43m20221213164545540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164545540 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b78d54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164545540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164545540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164545541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164545541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164545543 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164545543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164545543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164545543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:46.539279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7369): Terminating (SIGTERM) 16:45:46.582274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7372): Terminating (SIGTERM) 16:45:46.625705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7375): Terminating (SIGTERM) 16:45:46.669761 --- ParallelTerminationStrategy: PID 7369 died... 16:45:46.689561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7369): Terminated: ok {rc=0} 16:45:46.737181 --- ParallelTerminationStrategy: PID 7372 died... 16:45:46.757201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7372): Terminated: ok {rc=0} 16:45:46.804575 --- ParallelTerminationStrategy: PID 7375 died... 16:45:46.825458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7375): Terminated: ok {rc=0} 16:45:46.912120 bus /sierra_3: Setting Powered False 16:45:48.012735 bus /sierra_3: Setting Powered False 16:45:49.130172 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 16:45:50.370574 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:50.376476 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:45:50.408848 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 16:45:50.415933 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 16:45:50.451233 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:45:50.483284 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 16:45:50.489990 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 16:45:51.012918 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2391 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 16:45:51.018565 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 16:45:51.030263 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 16:45:51.079140 tst assert_extension.py: using LAC 34929 16:45:51.206453 tst assert_extension.py: using RAC 249 16:45:51.340545 tst assert_extension.py: using CellId 34929 16:45:51.466783 tst assert_extension.py: using BVCI 34930 16:45:51.585089 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 16:45:51.702688 tst assert_extension.py:10: start nitb and bts... 16:45:51.915564 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:45:52.582939 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7382): Launched 16:45:52.911833 run osmo-nitb_10.42.42.2(pid=7383): Launched 16:45:53.094417 run osmo-nitb_10.42.42.2(pid=7383): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7383)] 16:45:53.240740 run osmo-nitb_10.42.42.2(pid=7383): stdout: | (launched: 2022-12-13_16:45:52.851097) 16:45:53.388825 run osmo-nitb_10.42.42.2(pid=7383): stderr: | (launched: 2022-12-13_16:45:52.899690) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:45:53.536729 run osmo-nitb_10.42.42.2(pid=7383): stdout: | (launched: 2022-12-13_16:45:52.851097) 16:45:53.679290 run osmo-nitb_10.42.42.2(pid=7383): stderr: | (launched: 2022-12-13_16:45:52.899690) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7383): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7383) [trial-2391↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7383)] 16:45:54.036678 tst osmo-nitb_10.42.42.2(pid=7383): stdout: | (launched: 2022-12-13_16:45:52.851097) 16:45:54.168837 tst osmo-nitb_10.42.42.2(pid=7383): stderr: | (launched: 2022-12-13_16:45:52.899690) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:45:54.324564 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7383): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7383) [trial-2391↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7383)] [trial-2391↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 16:45:54.333810 tst assert_extension.py:12: Test FAILED (3.3 sec) 16:45:54.340939 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7382): Terminating (SIGTERM) 16:45:54.552487 --- ParallelTerminationStrategy: PID 7382 died... 16:45:54.574307 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7382): Terminated: ok {rc=0} 16:45:54.663180 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 ussd:nanobts+band-900 --------------------------------------------------------------------- 16:45:55.842575 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:55.848170 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:45:55.881643 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 16:45:55.911324 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 16:45:55.948609 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:45:55.982485 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 16:45:56.010621 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 16:45:56.540313 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2391 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 16:45:56.546511 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:56.558744 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 16:45:56.604660 tst assert_extension.py: using LAC 34930 16:45:56.734355 tst assert_extension.py: using RAC 250 16:45:56.863410 tst assert_extension.py: using CellId 34930 16:45:56.984722 tst assert_extension.py: using BVCI 34931 16:45:57.096422 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:57.107735 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:57.118599 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:57.129458 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:57.140225 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:57.150840 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 16:45:57.265568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:57.739117 run create_hlr_db(pid=7388): Launched 16:45:57.865035 bus /sierra_2: Setting Powered False 16:45:58.926368 run create_hlr_db(pid=7388): Terminated: ok {rc=0} 16:45:59.355791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7390): Launched 16:45:59.663895 run osmo-hlr_10.42.42.2(pid=7391): Launched 16:45:59.781417 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:00.327401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7393): Launched 16:46:00.636432 run osmo-stp_10.42.42.5(pid=7394): Launched 16:46:00.753831 run osmo-msc_10.42.42.6: Starting osmo-msc 16:46:01.393200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7396): Launched 16:46:01.741064 run osmo-msc_10.42.42.6(pid=7397): Launched 16:46:02.219019 run osmo-stp_10.42.42.5(pid=7394): ERR: Terminated: ERROR {rc=1} [trial-2391↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7394)] 16:46:02.371007 run osmo-stp_10.42.42.5(pid=7394): stdout: | (launched: 2022-12-13_16:46:00.578778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:02.507299 run osmo-stp_10.42.42.5(pid=7394): stderr: | [0;m[38;5;43m20221213164600750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164600750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164600751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164600751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164600752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164600752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164600752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:02.643483 run osmo-stp_10.42.42.5(pid=7394): stdout: | (launched: 2022-12-13_16:46:00.578778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:02.774189 run osmo-stp_10.42.42.5(pid=7394): stderr: | [0;m[38;5;43m20221213164600750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164600750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164600751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164600751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164600752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164600752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164600752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:02.929963 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7394): Process ended prematurely: osmo-stp_10.42.42.5(pid=7394) [trial-2391↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7394)] [trial-2391↪ussd:nanobts+band-900↪assert_extension.py:17] 16:46:02.939067 tst assert_extension.py:17: Test FAILED (6.4 sec) 16:46:02.966930 run osmo-hlr_10.42.42.2(pid=7391): ERR: Terminated: ERROR {rc=237} [trial-2391↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7391)] 16:46:03.018652 run osmo-hlr_10.42.42.2(pid=7391): stdout: | (launched: 2022-12-13_16:45:59.606620) 16:46:03.071623 run osmo-hlr_10.42.42.2(pid=7391): stderr: | [0;m[1;31m20221213164559783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164559783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164559783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164559783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164559783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164559783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164559795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164559803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164559803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164559804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:03.145490 run osmo-msc_10.42.42.6(pid=7397): ERR: Terminated: ERROR {rc=2} [trial-2391↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7397)] 16:46:03.196137 run osmo-msc_10.42.42.6(pid=7397): stdout: | (launched: 2022-12-13_16:46:01.679625) 16:46:03.249401 run osmo-msc_10.42.42.6(pid=7397): stderr: | [0;m[38;5;43m20221213164602014 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164602014 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f64dfac6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164602014 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164602014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164602015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164602016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164602020 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164602020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164602021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164602021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:46:03.303134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7390): Terminating (SIGTERM) 16:46:03.345683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7393): Terminating (SIGTERM) 16:46:03.388608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7396): Terminating (SIGTERM) 16:46:03.431866 --- ParallelTerminationStrategy: PID 7390 died... 16:46:03.452867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7390): Terminated: ok {rc=0} 16:46:03.500059 --- ParallelTerminationStrategy: PID 7393 died... 16:46:03.520341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7393): Terminated: ok {rc=0} 16:46:03.567162 --- ParallelTerminationStrategy: PID 7396 died... 16:46:03.587399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7396): Terminated: ok {rc=0} 16:46:03.676531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:46:04.892493 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:46:04.900818 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:46:04.935205 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:46:04.963238 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:46:05.016628 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:46:05.050292 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:46:05.078530 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:46:05.633306 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:46:05.689412 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:05.701480 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:46:05.772834 tst mo_mt_call.py: using LAC 34931 16:46:05.904211 tst mo_mt_call.py: using RAC 251 16:46:06.036224 tst mo_mt_call.py: using CellId 34931 16:46:06.166759 tst mo_mt_call.py: using BVCI 34932 16:46:06.289617 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:06.301701 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:06.313497 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:06.325261 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:06.337424 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:06.349470 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:46:06.469092 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:46:06.592849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:07.108331 run create_hlr_db(pid=7402): Launched 16:46:07.236849 bus /sierra_2: Setting Powered False 16:46:08.302505 run create_hlr_db(pid=7402): Terminated: ok {rc=0} 16:46:08.766149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7404): Launched 16:46:09.100711 run osmo-hlr_10.42.42.2(pid=7405): Launched 16:46:09.230216 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:09.808268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7407): Launched 16:46:10.144897 run osmo-stp_10.42.42.5(pid=7408): Launched 16:46:10.274930 run osmo-msc_10.42.42.6: Starting osmo-msc 16:46:10.876405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7410): Launched 16:46:11.212228 run osmo-msc_10.42.42.6(pid=7411): Launched 16:46:11.401096 run osmo-stp_10.42.42.5(pid=7408): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7408)] 16:46:11.540921 run osmo-stp_10.42.42.5(pid=7408): stdout: | (launched: 2022-12-13_16:46:10.083554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:11.682329 run osmo-stp_10.42.42.5(pid=7408): stderr: | [0;m[38;5;43m20221213164610278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164610278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164610279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164610279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164610279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164610279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164610279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:11.821815 run osmo-stp_10.42.42.5(pid=7408): stdout: | (launched: 2022-12-13_16:46:10.083554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:11.954013 run osmo-stp_10.42.42.5(pid=7408): stderr: | [0;m[38;5;43m20221213164610278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164610278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164610279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164610279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164610279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164610279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164610279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:12.112588 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7408): Process ended prematurely: osmo-stp_10.42.42.5(pid=7408) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7408)] [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:46:12.122391 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:46:12.150459 run osmo-hlr_10.42.42.2(pid=7405): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7405)] 16:46:12.201309 run osmo-hlr_10.42.42.2(pid=7405): stdout: | (launched: 2022-12-13_16:46:09.039309) 16:46:12.253397 run osmo-hlr_10.42.42.2(pid=7405): stderr: | [0;m[1;31m20221213164609238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164609238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164609238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164609238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164609239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164609239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164609251 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164609260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164609260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164609260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:12.326688 run osmo-msc_10.42.42.6(pid=7411): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7411)] 16:46:12.376835 run osmo-msc_10.42.42.6(pid=7411): stdout: | (launched: 2022-12-13_16:46:11.150736) 16:46:12.428829 run osmo-msc_10.42.42.6(pid=7411): stderr: | [0;m[38;5;43m20221213164611472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164611472 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a9a214c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164611472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164611473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164611473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164611473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164611475 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164611475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164611475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164611475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:46:12.481337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7404): Terminating (SIGTERM) 16:46:12.523532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7407): Terminating (SIGTERM) 16:46:12.565860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7410): Terminating (SIGTERM) 16:46:12.608304 --- ParallelTerminationStrategy: PID 7404 died... 16:46:12.628898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7404): Terminated: ok {rc=0} 16:46:12.675990 --- ParallelTerminationStrategy: PID 7407 died... 16:46:12.696178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7407): Terminated: ok {rc=0} 16:46:12.742918 --- ParallelTerminationStrategy: PID 7410 died... 16:46:12.763055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7410): Terminated: ok {rc=0} 16:46:12.852173 bus /sierra_3: Setting Powered False 16:46:13.952392 bus /sierra_3: Setting Powered False 16:46:15.070038 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:46:16.241368 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:16.257263 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:46:16.346989 tst mo_mt_call_osmux.py: using LAC 34932 16:46:16.480233 tst mo_mt_call_osmux.py: using RAC 252 16:46:16.612632 tst mo_mt_call_osmux.py: using CellId 34932 16:46:16.755871 tst mo_mt_call_osmux.py: using BVCI 34933 16:46:16.882187 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:16.895429 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:16.908411 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:16.921355 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:16.935208 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:46:16.951605 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:46:17.096248 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:46:17.221710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:17.708000 run create_hlr_db(pid=7413): Launched 16:46:17.836298 bus /sierra_2: Setting Powered False 16:46:18.898936 run create_hlr_db(pid=7413): Terminated: ok {rc=0} 16:46:19.355208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7415): Launched 16:46:19.693465 run osmo-hlr_10.42.42.2(pid=7416): Launched 16:46:19.822077 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:20.400282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7418): Launched 16:46:20.739091 run osmo-stp_10.42.42.5(pid=7419): Launched 16:46:20.868910 run osmo-msc_10.42.42.6: Starting osmo-msc 16:46:21.474316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7421): Launched 16:46:21.811254 run osmo-msc_10.42.42.6(pid=7422): Launched 16:46:22.000107 run osmo-stp_10.42.42.5(pid=7419): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7419)] 16:46:22.141459 run osmo-stp_10.42.42.5(pid=7419): stdout: | (launched: 2022-12-13_16:46:20.676627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:22.283707 run osmo-stp_10.42.42.5(pid=7419): stderr: | [0;m[38;5;43m20221213164620872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164620872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164620872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164620873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164620873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164620873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164620873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:22.423320 run osmo-stp_10.42.42.5(pid=7419): stdout: | (launched: 2022-12-13_16:46:20.676627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:22.555914 run osmo-stp_10.42.42.5(pid=7419): stderr: | [0;m[38;5;43m20221213164620872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164620872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164620872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164620873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164620873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164620873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164620873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:22.715308 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7419): Process ended prematurely: osmo-stp_10.42.42.5(pid=7419) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7419)] [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:46:22.725222 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:46:22.753648 run osmo-hlr_10.42.42.2(pid=7416): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7416)] 16:46:22.804671 run osmo-hlr_10.42.42.2(pid=7416): stdout: | (launched: 2022-12-13_16:46:19.631373) 16:46:22.857352 run osmo-hlr_10.42.42.2(pid=7416): stderr: | [0;m[1;31m20221213164619832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164619832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164619832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164619832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164619832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164619832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164619844 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164619853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164619853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164619853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:22.930205 run osmo-msc_10.42.42.6(pid=7422): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7422)] 16:46:22.980486 run osmo-msc_10.42.42.6(pid=7422): stdout: | (launched: 2022-12-13_16:46:21.749867) 16:46:23.033122 run osmo-msc_10.42.42.6(pid=7422): stderr: | [0;m[38;5;43m20221213164622143 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164622144 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff6a9f98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164622144 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164622144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164622144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164622144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164622146 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164622146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164622146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164622146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:46:23.085647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7415): Terminating (SIGTERM) 16:46:23.127904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7418): Terminating (SIGTERM) 16:46:23.170773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7421): Terminating (SIGTERM) 16:46:23.213728 --- ParallelTerminationStrategy: PID 7415 died... 16:46:23.234222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7415): Terminated: ok {rc=0} 16:46:23.281188 --- ParallelTerminationStrategy: PID 7418 died... 16:46:23.301236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7418): Terminated: ok {rc=0} 16:46:23.347857 --- ParallelTerminationStrategy: PID 7421 died... 16:46:23.367803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7421): Terminated: ok {rc=0} 16:46:23.456812 bus /sierra_3: Setting Powered False 16:46:24.556453 bus /sierra_3: Setting Powered False 16:46:25.673266 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:46:26.934021 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:46:26.942387 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:46:26.977190 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:46:27.005306 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:46:27.060094 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:46:27.092485 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:46:27.119459 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:46:27.673626 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:46:27.724829 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:27.736394 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:46:27.804938 tst mo_mt_call.py: using LAC 34933 16:46:27.929267 tst mo_mt_call.py: using RAC 253 16:46:28.050811 tst mo_mt_call.py: using CellId 34933 16:46:28.175070 tst mo_mt_call.py: using BVCI 34934 16:46:28.289335 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:28.300793 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:28.311888 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:28.322938 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:28.334169 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:28.345560 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:46:28.462854 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:46:28.583118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:29.066252 run create_hlr_db(pid=7427): Launched 16:46:29.196410 bus /sierra_2: Setting Powered False 16:46:30.258994 run create_hlr_db(pid=7427): Terminated: ok {rc=0} 16:46:30.714205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7429): Launched 16:46:31.107270 run osmo-hlr_10.42.42.2(pid=7430): Launched 16:46:31.361429 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:32.040508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7432): Launched 16:46:32.384823 run osmo-stp_10.42.42.5(pid=7433): Launched 16:46:32.504316 run osmo-msc_10.42.42.6: Starting osmo-msc 16:46:33.070663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7435): Launched 16:46:33.387056 run osmo-msc_10.42.42.6(pid=7436): Launched 16:46:33.565617 run osmo-stp_10.42.42.5(pid=7433): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7433)] 16:46:33.697930 run osmo-stp_10.42.42.5(pid=7433): stdout: | (launched: 2022-12-13_16:46:32.326613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:33.829393 run osmo-stp_10.42.42.5(pid=7433): stderr: | [0;m[38;5;43m20221213164632499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164632499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164632499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164632500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164632500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164632500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164632500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:33.958963 run osmo-stp_10.42.42.5(pid=7433): stdout: | (launched: 2022-12-13_16:46:32.326613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:34.082448 run osmo-stp_10.42.42.5(pid=7433): stderr: | [0;m[38;5;43m20221213164632499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164632499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164632499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164632500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164632500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164632500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164632500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:34.230725 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7433): Process ended prematurely: osmo-stp_10.42.42.5(pid=7433) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7433)] [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:46:34.239933 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 16:46:34.266448 run osmo-hlr_10.42.42.2(pid=7430): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7430)] 16:46:34.314166 run osmo-hlr_10.42.42.2(pid=7430): stdout: | (launched: 2022-12-13_16:46:31.040711) 16:46:34.363531 run osmo-hlr_10.42.42.2(pid=7430): stderr: | [0;m[1;31m20221213164631354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164631354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164631354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164631355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164631355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164631355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164631368 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164631377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164631377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164631377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:34.432786 run osmo-msc_10.42.42.6(pid=7436): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7436)] 16:46:34.480900 run osmo-msc_10.42.42.6(pid=7436): stdout: | (launched: 2022-12-13_16:46:33.328525) 16:46:34.530314 run osmo-msc_10.42.42.6(pid=7436): stderr: | [0;m[38;5;43m20221213164633599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164633599 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8051dc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164633599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164633599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164633600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164633600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164633602 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164633602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164633602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164633602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:46:34.580191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7429): Terminating (SIGTERM) 16:46:34.620178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7432): Terminating (SIGTERM) 16:46:34.660247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7435): Terminating (SIGTERM) 16:46:34.700535 --- ParallelTerminationStrategy: PID 7429 died... 16:46:34.719785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7429): Terminated: ok {rc=0} 16:46:34.764534 --- ParallelTerminationStrategy: PID 7432 died... 16:46:34.783418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7432): Terminated: ok {rc=0} 16:46:34.827444 --- ParallelTerminationStrategy: PID 7435 died... 16:46:34.846220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7435): Terminated: ok {rc=0} 16:46:34.932454 bus /sierra_3: Setting Powered False 16:46:36.033444 bus /sierra_3: Setting Powered False 16:46:37.150539 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:46:38.298361 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:38.310397 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:46:38.378330 tst mo_mt_call_osmux.py: using LAC 34934 16:46:38.502237 tst mo_mt_call_osmux.py: using RAC 254 16:46:38.625798 tst mo_mt_call_osmux.py: using CellId 34934 16:46:38.748503 tst mo_mt_call_osmux.py: using BVCI 34935 16:46:38.862879 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:38.874236 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:38.885379 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:38.896409 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:38.907665 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:46:38.918766 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:46:39.036528 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:46:39.159705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:39.678111 run create_hlr_db(pid=7438): Launched 16:46:39.809041 bus /sierra_2: Setting Powered False 16:46:40.874333 run create_hlr_db(pid=7438): Terminated: ok {rc=0} 16:46:41.321434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7440): Launched 16:46:41.637449 run osmo-hlr_10.42.42.2(pid=7441): Launched 16:46:41.757497 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:42.311599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7443): Launched 16:46:42.627961 run osmo-stp_10.42.42.5(pid=7444): Launched 16:46:42.748423 run osmo-msc_10.42.42.6: Starting osmo-msc 16:46:43.315649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7446): Launched 16:46:43.630604 run osmo-msc_10.42.42.6(pid=7447): Launched 16:46:43.807139 run osmo-stp_10.42.42.5(pid=7444): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7444)] 16:46:43.939720 run osmo-stp_10.42.42.5(pid=7444): stdout: | (launched: 2022-12-13_16:46:42.569824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:44.072891 run osmo-stp_10.42.42.5(pid=7444): stderr: | [0;m[38;5;43m20221213164642742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164642742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164642743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164642743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164642743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164642744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164642744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:44.203155 run osmo-stp_10.42.42.5(pid=7444): stdout: | (launched: 2022-12-13_16:46:42.569824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:44.327411 run osmo-stp_10.42.42.5(pid=7444): stderr: | [0;m[38;5;43m20221213164642742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164642742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164642743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164642743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164642743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164642744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164642744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:44.476450 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7444): Process ended prematurely: osmo-stp_10.42.42.5(pid=7444) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7444)] [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:46:44.485868 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:46:44.512792 run osmo-hlr_10.42.42.2(pid=7441): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7441)] 16:46:44.561903 run osmo-hlr_10.42.42.2(pid=7441): stdout: | (launched: 2022-12-13_16:46:41.579390) 16:46:44.611931 run osmo-hlr_10.42.42.2(pid=7441): stderr: | [0;m[1;31m20221213164641758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164641758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164641758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164641758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164641758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164641758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164641771 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164641782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164641783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164641783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:44.682716 run osmo-msc_10.42.42.6(pid=7447): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7447)] 16:46:44.730437 run osmo-msc_10.42.42.6(pid=7447): stdout: | (launched: 2022-12-13_16:46:43.572114) 16:46:44.780282 run osmo-msc_10.42.42.6(pid=7447): stderr: | [0;m[38;5;43m20221213164643846 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164643847 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc7b1c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164643847 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164643847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164643847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164643847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164643849 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164643849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164643849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164643850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:46:44.830543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7440): Terminating (SIGTERM) 16:46:44.871000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7443): Terminating (SIGTERM) 16:46:44.911272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7446): Terminating (SIGTERM) 16:46:44.952041 --- ParallelTerminationStrategy: PID 7440 died... 16:46:44.971881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7440): Terminated: ok {rc=0} 16:46:45.016620 --- ParallelTerminationStrategy: PID 7443 died... 16:46:45.036209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7443): Terminated: ok {rc=0} 16:46:45.080900 --- ParallelTerminationStrategy: PID 7446 died... 16:46:45.100814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7446): Terminated: ok {rc=0} 16:46:45.188364 bus /sierra_3: Setting Powered False 16:46:46.285724 bus /sierra_3: Setting Powered False 16:46:47.402315 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:46:48.654853 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:46:48.662165 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:46:48.694422 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:46:48.721513 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:46:48.773081 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:46:48.806068 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:46:48.833553 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:46:49.385939 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:46:49.442954 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:46:49.454959 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:46:49.524545 tst mo_mt_call.py: using LAC 34935 16:46:49.655329 tst mo_mt_call.py: using RAC 255 16:46:49.788311 tst mo_mt_call.py: using CellId 34935 16:46:49.918399 tst mo_mt_call.py: using BVCI 34936 16:46:50.040517 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:46:50.052340 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:46:50.063923 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:46:50.075453 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:46:50.087660 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:46:50.099694 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:46:50.219918 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:46:50.342151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:50.860107 run create_hlr_db(pid=7452): Launched 16:46:50.988927 bus /sierra_2: Setting Powered False 16:46:52.055059 run create_hlr_db(pid=7452): Terminated: ok {rc=0} 16:46:52.518982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7454): Launched 16:46:52.855185 run osmo-hlr_10.42.42.2(pid=7455): Launched 16:46:52.985559 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:53.560123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7457): Launched 16:46:53.897017 run osmo-stp_10.42.42.5(pid=7458): Launched 16:46:54.026288 run osmo-msc_10.42.42.6: Starting osmo-msc 16:46:54.628757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7460): Launched 16:46:54.966007 run osmo-msc_10.42.42.6(pid=7461): Launched 16:46:55.154816 run osmo-stp_10.42.42.5(pid=7458): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7458)] 16:46:55.295552 run osmo-stp_10.42.42.5(pid=7458): stdout: | (launched: 2022-12-13_16:46:53.835575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:55.436664 run osmo-stp_10.42.42.5(pid=7458): stderr: | [0;m[38;5;43m20221213164654030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164654031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164654031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164654031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164654032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164654032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164654032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:55.576049 run osmo-stp_10.42.42.5(pid=7458): stdout: | (launched: 2022-12-13_16:46:53.835575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:55.708827 run osmo-stp_10.42.42.5(pid=7458): stderr: | [0;m[38;5;43m20221213164654030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164654031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164654031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164654031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164654032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164654032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164654032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:55.868250 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7458): Process ended prematurely: osmo-stp_10.42.42.5(pid=7458) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7458)] [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:46:55.878290 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:46:55.906692 run osmo-hlr_10.42.42.2(pid=7455): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7455)] 16:46:55.957786 run osmo-hlr_10.42.42.2(pid=7455): stdout: | (launched: 2022-12-13_16:46:52.793401) 16:46:56.010482 run osmo-hlr_10.42.42.2(pid=7455): stderr: | [0;m[1;31m20221213164652993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164652993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164652993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164652993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164652993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164652993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164653006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164653016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164653017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164653017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:56.083737 run osmo-msc_10.42.42.6(pid=7461): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7461)] 16:46:56.133957 run osmo-msc_10.42.42.6(pid=7461): stdout: | (launched: 2022-12-13_16:46:54.904397) 16:46:56.186246 run osmo-msc_10.42.42.6(pid=7461): stderr: | [0;m[38;5;43m20221213164655230 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164655230 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6b0aaf0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164655230 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164655230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164655230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164655230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164655232 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164655232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164655232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164655232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:46:56.239088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7454): Terminating (SIGTERM) 16:46:56.281120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7457): Terminating (SIGTERM) 16:46:56.323501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7460): Terminating (SIGTERM) 16:46:56.366388 --- ParallelTerminationStrategy: PID 7454 died... 16:46:56.387300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7454): Terminated: ok {rc=0} 16:46:56.434321 --- ParallelTerminationStrategy: PID 7457 died... 16:46:56.454560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7457): Terminated: ok {rc=0} 16:46:56.501291 --- ParallelTerminationStrategy: PID 7460 died... 16:46:56.521542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7460): Terminated: ok {rc=0} 16:46:56.611390 bus /sierra_3: Setting Powered False 16:46:57.711511 bus /sierra_3: Setting Powered False 16:46:58.828386 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:46:59.979410 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:46:59.992281 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:47:00.066863 tst mo_mt_call_osmux.py: using LAC 34936 16:47:00.198200 tst mo_mt_call_osmux.py: using RAC 1 16:47:00.330379 tst mo_mt_call_osmux.py: using CellId 34936 16:47:00.462123 tst mo_mt_call_osmux.py: using BVCI 34937 16:47:00.586454 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:47:00.598364 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:47:00.610104 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:47:00.621883 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:47:00.634193 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:47:00.646425 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:47:00.765950 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:47:00.903616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:01.442030 run create_hlr_db(pid=7463): Launched 16:47:01.605653 bus /sierra_2: Setting Powered False 16:47:02.667985 run create_hlr_db(pid=7463): Terminated: ok {rc=0} 16:47:03.141913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7465): Launched 16:47:03.478969 run osmo-hlr_10.42.42.2(pid=7466): Launched 16:47:03.608911 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:04.183521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7468): Launched 16:47:04.517962 run osmo-stp_10.42.42.5(pid=7469): Launched 16:47:04.647187 run osmo-msc_10.42.42.6: Starting osmo-msc 16:47:05.250529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7471): Launched 16:47:05.586449 run osmo-msc_10.42.42.6(pid=7472): Launched 16:47:05.774837 run osmo-stp_10.42.42.5(pid=7469): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7469)] 16:47:05.916420 run osmo-stp_10.42.42.5(pid=7469): stdout: | (launched: 2022-12-13_16:47:04.456496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:06.058886 run osmo-stp_10.42.42.5(pid=7469): stderr: | [0;m[38;5;43m20221213164704650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164704650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164704651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164704651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164704651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164704652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164704652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:06.199099 run osmo-stp_10.42.42.5(pid=7469): stdout: | (launched: 2022-12-13_16:47:04.456496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:06.332072 run osmo-stp_10.42.42.5(pid=7469): stderr: | [0;m[38;5;43m20221213164704650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164704650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164704651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164704651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164704651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164704652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164704652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:06.491661 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7469): Process ended prematurely: osmo-stp_10.42.42.5(pid=7469) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7469)] [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:47:06.501632 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 16:47:06.530002 run osmo-hlr_10.42.42.2(pid=7466): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7466)] 16:47:06.581396 run osmo-hlr_10.42.42.2(pid=7466): stdout: | (launched: 2022-12-13_16:47:03.417782) 16:47:06.633863 run osmo-hlr_10.42.42.2(pid=7466): stderr: | [0;m[1;31m20221213164703618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164703618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164703618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164703618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164703618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164703618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164703631 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164703639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164703640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164703640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:06.707668 run osmo-msc_10.42.42.6(pid=7472): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7472)] 16:47:06.757740 run osmo-msc_10.42.42.6(pid=7472): stdout: | (launched: 2022-12-13_16:47:05.524029) 16:47:06.810073 run osmo-msc_10.42.42.6(pid=7472): stderr: | [0;m[38;5;43m20221213164705847 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164705847 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f86d6e65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164705847 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164705847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164705847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164705848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164705849 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164705850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164705850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164705850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:47:06.863329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7465): Terminating (SIGTERM) 16:47:06.905716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7468): Terminating (SIGTERM) 16:47:06.948547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7471): Terminating (SIGTERM) 16:47:06.991580 --- ParallelTerminationStrategy: PID 7465 died... 16:47:07.012055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7465): Terminated: ok {rc=0} 16:47:07.058661 --- ParallelTerminationStrategy: PID 7468 died... 16:47:07.078707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7468): Terminated: ok {rc=0} 16:47:07.125273 --- ParallelTerminationStrategy: PID 7471 died... 16:47:07.145322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7471): Terminated: ok {rc=0} 16:47:07.234491 bus /sierra_3: Setting Powered False 16:47:08.334137 bus /sierra_3: Setting Powered False 16:47:09.450339 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:47:10.707647 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:47:10.715811 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:47:10.749464 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:47:10.777942 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:47:10.831361 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:47:10.864392 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:47:10.892146 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:47:11.446777 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:47:11.500417 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:11.512381 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:47:11.582047 tst mo_mt_call.py: using LAC 34937 16:47:11.714017 tst mo_mt_call.py: using RAC 2 16:47:11.836828 tst mo_mt_call.py: using CellId 34937 16:47:11.961085 tst mo_mt_call.py: using BVCI 34938 16:47:12.075622 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:12.087074 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:12.098430 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:12.109640 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:12.120774 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:12.131840 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:47:12.249276 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:47:12.371406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:12.888347 run create_hlr_db(pid=7477): Launched 16:47:13.018550 bus /sierra_2: Setting Powered False 16:47:14.083942 run create_hlr_db(pid=7477): Terminated: ok {rc=0} 16:47:14.528864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7479): Launched 16:47:14.842013 run osmo-hlr_10.42.42.2(pid=7480): Launched 16:47:14.961942 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:15.516689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7482): Launched 16:47:15.837828 run osmo-stp_10.42.42.5(pid=7483): Launched 16:47:16.127355 run osmo-msc_10.42.42.6: Starting osmo-msc 16:47:16.778636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7485): Launched 16:47:17.134431 run osmo-msc_10.42.42.6(pid=7486): Launched 16:47:17.362866 run osmo-stp_10.42.42.5(pid=7483): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7483)] 16:47:17.506274 run osmo-stp_10.42.42.5(pid=7483): stdout: | (launched: 2022-12-13_16:47:15.772764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:17.654368 run osmo-stp_10.42.42.5(pid=7483): stderr: | [0;m[38;5;43m20221213164716014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164716014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164716015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164716015 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164716016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164716016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164716017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:17.794583 run osmo-stp_10.42.42.5(pid=7483): stdout: | (launched: 2022-12-13_16:47:15.772764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:17.927007 run osmo-stp_10.42.42.5(pid=7483): stderr: | [0;m[38;5;43m20221213164716014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164716014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164716015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164716015 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164716016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164716016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164716017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:18.085925 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7483): Process ended prematurely: osmo-stp_10.42.42.5(pid=7483) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7483)] [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:47:18.095915 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 16:47:18.124392 run osmo-hlr_10.42.42.2(pid=7480): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7480)] 16:47:18.176699 run osmo-hlr_10.42.42.2(pid=7480): stdout: | (launched: 2022-12-13_16:47:14.784094) 16:47:18.229786 run osmo-hlr_10.42.42.2(pid=7480): stderr: | [0;m[1;31m20221213164714961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164714961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164714961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164714961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164714961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164714962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164714974 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164714983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164714983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164714983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:18.303845 run osmo-msc_10.42.42.6(pid=7486): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7486)] 16:47:18.354667 run osmo-msc_10.42.42.6(pid=7486): stdout: | (launched: 2022-12-13_16:47:17.071561) 16:47:18.407688 run osmo-msc_10.42.42.6(pid=7486): stderr: | [0;m[38;5;43m20221213164717454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164717455 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc918245c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164717455 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164717455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164717455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164717455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164717457 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164717457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164717457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164717457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:47:18.460879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7479): Terminating (SIGTERM) 16:47:18.503287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7482): Terminating (SIGTERM) 16:47:18.546031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7485): Terminating (SIGTERM) 16:47:18.589167 --- ParallelTerminationStrategy: PID 7479 died... 16:47:18.609880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7479): Terminated: ok {rc=0} 16:47:18.656880 --- ParallelTerminationStrategy: PID 7482 died... 16:47:18.677551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7482): Terminated: ok {rc=0} 16:47:18.724681 --- ParallelTerminationStrategy: PID 7485 died... 16:47:18.744997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7485): Terminated: ok {rc=0} 16:47:18.834725 bus /sierra_3: Setting Powered False 16:47:19.934472 bus /sierra_3: Setting Powered False 16:47:21.051503 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:47:22.203349 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:22.216036 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:47:22.286612 tst mo_mt_call_osmux.py: using LAC 34938 16:47:22.412003 tst mo_mt_call_osmux.py: using RAC 3 16:47:22.539907 tst mo_mt_call_osmux.py: using CellId 34938 16:47:22.670751 tst mo_mt_call_osmux.py: using BVCI 34939 16:47:22.783878 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:22.798337 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:22.810015 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:22.821810 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:22.834077 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:47:22.846563 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:47:22.969906 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:47:23.088367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:23.574067 run create_hlr_db(pid=7488): Launched 16:47:23.705190 bus /sierra_2: Setting Powered False 16:47:24.767804 run create_hlr_db(pid=7488): Terminated: ok {rc=0} 16:47:25.203920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7490): Launched 16:47:25.518806 run osmo-hlr_10.42.42.2(pid=7491): Launched 16:47:25.640423 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:26.195252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7493): Launched 16:47:26.508374 run osmo-stp_10.42.42.5(pid=7494): Launched 16:47:26.628260 run osmo-msc_10.42.42.6: Starting osmo-msc 16:47:27.193985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7496): Launched 16:47:27.507292 run osmo-msc_10.42.42.6(pid=7497): Launched 16:47:27.688859 run osmo-stp_10.42.42.5(pid=7494): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7494)] 16:47:27.825142 run osmo-stp_10.42.42.5(pid=7494): stdout: | (launched: 2022-12-13_16:47:26.450341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:27.956891 run osmo-stp_10.42.42.5(pid=7494): stderr: | [0;m[38;5;43m20221213164726624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164726624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164726625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164726625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164726625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164726626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164726626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:28.086686 run osmo-stp_10.42.42.5(pid=7494): stdout: | (launched: 2022-12-13_16:47:26.450341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:28.210262 run osmo-stp_10.42.42.5(pid=7494): stderr: | [0;m[38;5;43m20221213164726624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164726624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164726625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164726625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164726625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164726626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164726626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:28.358192 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7494): Process ended prematurely: osmo-stp_10.42.42.5(pid=7494) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7494)] [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:47:28.367461 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:47:28.394280 run osmo-hlr_10.42.42.2(pid=7491): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7491)] 16:47:28.442298 run osmo-hlr_10.42.42.2(pid=7491): stdout: | (launched: 2022-12-13_16:47:25.460417) 16:47:28.491806 run osmo-hlr_10.42.42.2(pid=7491): stderr: | [0;m[1;31m20221213164725640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164725640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164725640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164725640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164725640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164725640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164725652 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164725660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164725661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164725661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:28.561259 run osmo-msc_10.42.42.6(pid=7497): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7497)] 16:47:28.608887 run osmo-msc_10.42.42.6(pid=7497): stdout: | (launched: 2022-12-13_16:47:27.449185) 16:47:28.658289 run osmo-msc_10.42.42.6(pid=7497): stderr: | [0;m[38;5;43m20221213164727722 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164727722 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6fdcd3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164727722 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164727722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164727722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164727723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164727724 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164727725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164727725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164727725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:47:28.707849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7490): Terminating (SIGTERM) 16:47:28.747857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7493): Terminating (SIGTERM) 16:47:28.787851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7496): Terminating (SIGTERM) 16:47:28.828104 --- ParallelTerminationStrategy: PID 7490 died... 16:47:28.847596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7490): Terminated: ok {rc=0} 16:47:28.891696 --- ParallelTerminationStrategy: PID 7493 died... 16:47:28.910612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7493): Terminated: ok {rc=0} 16:47:28.955045 --- ParallelTerminationStrategy: PID 7496 died... 16:47:28.974051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7496): Terminated: ok {rc=0} 16:47:29.060226 bus /sierra_3: Setting Powered False 16:47:30.159589 bus /sierra_3: Setting Powered False 16:47:31.273532 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:47:32.533131 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:47:32.540892 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:47:32.574016 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:47:32.605420 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:47:32.662254 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:47:32.696584 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:47:32.725247 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:47:33.275125 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:47:33.329156 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:33.341253 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:47:33.409534 tst mo_mt_call.py: using LAC 34939 16:47:33.533126 tst mo_mt_call.py: using RAC 4 16:47:33.653861 tst mo_mt_call.py: using CellId 34939 16:47:33.775078 tst mo_mt_call.py: using BVCI 34940 16:47:33.889661 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:33.901202 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:33.912575 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:33.923801 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:33.935110 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:33.946289 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:47:34.064386 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:47:34.187723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:34.671022 run create_hlr_db(pid=7504): Launched 16:47:34.800302 bus /sierra_2: Setting Powered False 16:47:35.863137 run create_hlr_db(pid=7504): Terminated: ok {rc=0} 16:47:36.298680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7506): Launched 16:47:36.612037 run osmo-hlr_10.42.42.2(pid=7507): Launched 16:47:36.731643 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:37.285291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7509): Launched 16:47:37.597953 run osmo-stp_10.42.42.5(pid=7510): Launched 16:47:37.717895 run osmo-msc_10.42.42.6: Starting osmo-msc 16:47:38.284642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7512): Launched 16:47:38.596729 run osmo-msc_10.42.42.6(pid=7513): Launched 16:47:38.771687 run osmo-stp_10.42.42.5(pid=7510): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7510)] 16:47:38.902983 run osmo-stp_10.42.42.5(pid=7510): stdout: | (launched: 2022-12-13_16:47:37.540000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:39.034623 run osmo-stp_10.42.42.5(pid=7510): stderr: | [0;m[38;5;43m20221213164737712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164737712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164737712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164737713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164737713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164737713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164737713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:39.163918 run osmo-stp_10.42.42.5(pid=7510): stdout: | (launched: 2022-12-13_16:47:37.540000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:39.287065 run osmo-stp_10.42.42.5(pid=7510): stderr: | [0;m[38;5;43m20221213164737712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164737712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164737712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164737713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164737713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164737713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164737713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:39.435149 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7510): Process ended prematurely: osmo-stp_10.42.42.5(pid=7510) [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7510)] [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:47:39.444415 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:47:39.470942 run osmo-hlr_10.42.42.2(pid=7507): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7507)] 16:47:39.518832 run osmo-hlr_10.42.42.2(pid=7507): stdout: | (launched: 2022-12-13_16:47:36.554043) 16:47:39.568726 run osmo-hlr_10.42.42.2(pid=7507): stderr: | [0;m[1;31m20221213164736732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164736732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164736732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164736732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164736732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164736732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164736745 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164736753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164736754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164736754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:39.638286 run osmo-msc_10.42.42.6(pid=7513): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7513)] 16:47:39.685942 run osmo-msc_10.42.42.6(pid=7513): stdout: | (launched: 2022-12-13_16:47:38.539193) 16:47:39.735346 run osmo-msc_10.42.42.6(pid=7513): stderr: | [0;m[38;5;43m20221213164738810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164738810 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffbfb962c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164738811 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164738811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164738811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164738811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164738813 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164738814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164738814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164738814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:47:39.785707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7506): Terminating (SIGTERM) 16:47:39.825455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7509): Terminating (SIGTERM) 16:47:39.865196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7512): Terminating (SIGTERM) 16:47:39.905363 --- ParallelTerminationStrategy: PID 7506 died... 16:47:39.924731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7506): Terminated: ok {rc=0} 16:47:39.968766 --- ParallelTerminationStrategy: PID 7509 died... 16:47:39.987650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7509): Terminated: ok {rc=0} 16:47:40.031588 --- ParallelTerminationStrategy: PID 7512 died... 16:47:40.050508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7512): Terminated: ok {rc=0} 16:47:40.136438 bus /sierra_3: Setting Powered False 16:47:41.235840 bus /sierra_3: Setting Powered False 16:47:42.352201 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:47:43.504058 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:43.516747 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:47:43.588305 tst mo_mt_call_osmux.py: using LAC 34940 16:47:43.720237 tst mo_mt_call_osmux.py: using RAC 5 16:47:43.850591 tst mo_mt_call_osmux.py: using CellId 34940 16:47:43.980758 tst mo_mt_call_osmux.py: using BVCI 34941 16:47:44.101932 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:44.113885 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:44.125654 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:44.137536 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:44.149961 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:47:44.162015 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:47:44.282846 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:47:44.406557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:44.923662 run create_hlr_db(pid=7515): Launched 16:47:45.052134 bus /sierra_2: Setting Powered False 16:47:46.115957 run create_hlr_db(pid=7515): Terminated: ok {rc=0} 16:47:46.591251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7517): Launched 16:47:46.944050 run osmo-hlr_10.42.42.2(pid=7518): Launched 16:47:47.177762 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:47.723139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7520): Launched 16:47:48.039446 run osmo-stp_10.42.42.5(pid=7521): Launched 16:47:48.159844 run osmo-msc_10.42.42.6: Starting osmo-msc 16:47:48.727252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7523): Launched 16:47:49.044724 run osmo-msc_10.42.42.6(pid=7530): Launched 16:47:49.221309 run osmo-stp_10.42.42.5(pid=7521): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7521)] 16:47:49.353288 run osmo-stp_10.42.42.5(pid=7521): stdout: | (launched: 2022-12-13_16:47:47.981051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:49.484925 run osmo-stp_10.42.42.5(pid=7521): stderr: | [0;m[38;5;43m20221213164748152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164748152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164748153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164748153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164748154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164748154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164748154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:49.615069 run osmo-stp_10.42.42.5(pid=7521): stdout: | (launched: 2022-12-13_16:47:47.981051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:49.739069 run osmo-stp_10.42.42.5(pid=7521): stderr: | [0;m[38;5;43m20221213164748152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164748152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164748153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164748153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164748154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164748154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164748154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:49.888346 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7521): Process ended prematurely: osmo-stp_10.42.42.5(pid=7521) [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7521)] [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:47:49.897371 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:47:49.924216 run osmo-hlr_10.42.42.2(pid=7518): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7518)] 16:47:49.973566 run osmo-hlr_10.42.42.2(pid=7518): stdout: | (launched: 2022-12-13_16:47:46.882665) 16:47:50.024001 run osmo-hlr_10.42.42.2(pid=7518): stderr: | [0;m[1;31m20221213164747080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164747080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164747080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164747080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164747080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164747080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164747095 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164747111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164747112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164747112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:50.094944 run osmo-msc_10.42.42.6(pid=7530): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7530)] 16:47:50.142928 run osmo-msc_10.42.42.6(pid=7530): stdout: | (launched: 2022-12-13_16:47:48.986581) 16:47:50.193249 run osmo-msc_10.42.42.6(pid=7530): stderr: | [0;m[38;5;43m20221213164749258 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164749259 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f899b1ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164749259 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164749259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164749259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164749259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164749261 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164749261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164749261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164749262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:47:50.243872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7517): Terminating (SIGTERM) 16:47:50.284160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7520): Terminating (SIGTERM) 16:47:50.324524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7523): Terminating (SIGTERM) 16:47:50.365362 --- ParallelTerminationStrategy: PID 7517 died... 16:47:50.385173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7517): Terminated: ok {rc=0} 16:47:50.429614 --- ParallelTerminationStrategy: PID 7520 died... 16:47:50.448877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7520): Terminated: ok {rc=0} 16:47:50.494006 --- ParallelTerminationStrategy: PID 7523 died... 16:47:50.513360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7523): Terminated: ok {rc=0} 16:47:50.600888 bus /sierra_3: Setting Powered False 16:47:51.701275 bus /sierra_3: Setting Powered False 16:47:52.817834 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:47:54.068174 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:47:54.075523 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:47:54.107741 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 16:47:54.134518 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 16:47:54.187437 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:47:54.221426 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 16:47:54.248133 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 16:47:54.803778 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 16:47:54.858904 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:47:54.870868 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:47:54.922409 tst mo_mt_call.py: using LAC 34941 16:47:55.054351 tst mo_mt_call.py: using RAC 6 16:47:55.185555 tst mo_mt_call.py: using CellId 34941 16:47:55.308784 tst mo_mt_call.py: using BVCI 34942 16:47:55.422521 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:47:55.434089 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:47:55.445463 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:47:55.456675 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:47:55.468058 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:47:55.479292 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:47:55.602791 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:47:55.724691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:56.242038 run create_hlr_db(pid=7535): Launched 16:47:56.372115 bus /sierra_2: Setting Powered False 16:47:57.438142 run create_hlr_db(pid=7535): Terminated: ok {rc=0} 16:47:57.885476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7537): Launched 16:47:58.199005 run osmo-hlr_10.42.42.2(pid=7538): Launched 16:47:58.319056 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:58.870958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7540): Launched 16:47:59.185461 run osmo-stp_10.42.42.5(pid=7541): Launched 16:47:59.304255 run osmo-msc_10.42.42.6: Starting osmo-msc 16:47:59.868001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7543): Launched 16:48:00.182462 run osmo-msc_10.42.42.6(pid=7544): Launched 16:48:00.359565 run osmo-stp_10.42.42.5(pid=7541): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7541)] 16:48:00.491029 run osmo-stp_10.42.42.5(pid=7541): stdout: | (launched: 2022-12-13_16:47:59.127581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:00.622577 run osmo-stp_10.42.42.5(pid=7541): stderr: | [0;m[38;5;43m20221213164759300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164759300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164759301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164759301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164759302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164759302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164759302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:00.752249 run osmo-stp_10.42.42.5(pid=7541): stdout: | (launched: 2022-12-13_16:47:59.127581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:00.897206 run osmo-stp_10.42.42.5(pid=7541): stderr: | [0;m[38;5;43m20221213164759300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164759300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164759301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164759301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164759302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164759302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164759302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:01.062444 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7541): Process ended prematurely: osmo-stp_10.42.42.5(pid=7541) [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7541)] [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 16:48:01.073481 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:48:01.102935 run osmo-hlr_10.42.42.2(pid=7538): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7538)] 16:48:01.158392 run osmo-hlr_10.42.42.2(pid=7538): stdout: | (launched: 2022-12-13_16:47:58.141333) 16:48:01.214355 run osmo-hlr_10.42.42.2(pid=7538): stderr: | [0;m[1;31m20221213164758322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164758322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164758322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164758322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164758322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164758322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164758334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164758342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164758343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164758343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:01.290319 run osmo-msc_10.42.42.6(pid=7544): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7544)] 16:48:01.343348 run osmo-msc_10.42.42.6(pid=7544): stdout: | (launched: 2022-12-13_16:48:00.123960) 16:48:01.398899 run osmo-msc_10.42.42.6(pid=7544): stderr: | [0;m[38;5;43m20221213164800399 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164800400 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f921604fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164800400 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164800400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164800400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164800400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164800402 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164800402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164800403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164800403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:48:01.456737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7537): Terminating (SIGTERM) 16:48:01.500880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7540): Terminating (SIGTERM) 16:48:01.547975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7543): Terminating (SIGTERM) 16:48:01.595600 --- ParallelTerminationStrategy: PID 7537 died... 16:48:01.619079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7537): Terminated: ok {rc=0} 16:48:01.671344 --- ParallelTerminationStrategy: PID 7540 died... 16:48:01.692376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7540): Terminated: ok {rc=0} 16:48:01.741664 --- ParallelTerminationStrategy: PID 7543 died... 16:48:01.763289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7543): Terminated: ok {rc=0} 16:48:01.858101 bus /sierra_3: Setting Powered False 16:48:02.961993 bus /sierra_3: Setting Powered False 16:48:04.079289 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 16:48:05.230970 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:48:05.243876 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:48:05.299657 tst mo_mt_call_osmux.py: using LAC 34942 16:48:05.430011 tst mo_mt_call_osmux.py: using RAC 7 16:48:05.560776 tst mo_mt_call_osmux.py: using CellId 34942 16:48:05.689403 tst mo_mt_call_osmux.py: using BVCI 34943 16:48:05.811258 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:48:05.823410 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:48:05.835288 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:48:05.847188 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:48:05.859464 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:48:05.871669 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:48:05.994173 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:48:06.117514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:06.633379 run create_hlr_db(pid=7546): Launched 16:48:06.760922 bus /sierra_2: Setting Powered False 16:48:07.822934 run create_hlr_db(pid=7546): Terminated: ok {rc=0} 16:48:08.268903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7548): Launched 16:48:08.583346 run osmo-hlr_10.42.42.2(pid=7549): Launched 16:48:08.703823 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:09.259781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7551): Launched 16:48:09.575776 run osmo-stp_10.42.42.5(pid=7552): Launched 16:48:09.697096 run osmo-msc_10.42.42.6: Starting osmo-msc 16:48:10.263274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7554): Launched 16:48:10.579697 run osmo-msc_10.42.42.6(pid=7555): Launched 16:48:10.756512 run osmo-stp_10.42.42.5(pid=7552): ERR: Terminated: ERROR {rc=1} [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7552)] 16:48:10.889678 run osmo-stp_10.42.42.5(pid=7552): stdout: | (launched: 2022-12-13_16:48:09.517620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:11.021771 run osmo-stp_10.42.42.5(pid=7552): stderr: | [0;m[38;5;43m20221213164809690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164809690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164809690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164809690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164809691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164809691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164809691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:11.152032 run osmo-stp_10.42.42.5(pid=7552): stdout: | (launched: 2022-12-13_16:48:09.517620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:11.275674 run osmo-stp_10.42.42.5(pid=7552): stderr: | [0;m[38;5;43m20221213164809690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164809690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164809690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164809690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164809691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164809691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164809691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:11.424193 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7552): Process ended prematurely: osmo-stp_10.42.42.5(pid=7552) [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7552)] [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 16:48:11.433327 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:48:11.460255 run osmo-hlr_10.42.42.2(pid=7549): ERR: Terminated: ERROR {rc=237} [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7549)] 16:48:11.508209 run osmo-hlr_10.42.42.2(pid=7549): stdout: | (launched: 2022-12-13_16:48:08.525273) 16:48:11.557840 run osmo-hlr_10.42.42.2(pid=7549): stderr: | [0;m[1;31m20221213164808705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164808705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164808705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164808705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164808705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164808706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164808718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164808726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164808726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164808727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:11.627311 run osmo-msc_10.42.42.6(pid=7555): ERR: Terminated: ERROR {rc=2} [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7555)] 16:48:11.675029 run osmo-msc_10.42.42.6(pid=7555): stdout: | (launched: 2022-12-13_16:48:10.521301) 16:48:11.724464 run osmo-msc_10.42.42.6(pid=7555): stderr: | [0;m[38;5;43m20221213164810796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164810796 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb96fc9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164810796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164810796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164810796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164810797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164810798 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164810799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164810799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164810799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:48:11.774467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7548): Terminating (SIGTERM) 16:48:11.814235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7551): Terminating (SIGTERM) 16:48:11.854094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7554): Terminating (SIGTERM) 16:48:11.894153 --- ParallelTerminationStrategy: PID 7548 died... 16:48:11.913466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7548): Terminated: ok {rc=0} 16:48:11.957454 --- ParallelTerminationStrategy: PID 7551 died... 16:48:11.976219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7551): Terminated: ok {rc=0} 16:48:12.020598 --- ParallelTerminationStrategy: PID 7554 died... 16:48:12.039389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7554): Terminated: ok {rc=0} 16:48:12.123798 bus /sierra_3: Setting Powered False 16:48:13.218805 bus /sierra_3: Setting Powered False 16:48:14.333832 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 emergency:nanobts+band-900 --------------------------------------------------------------------- 16:48:15.591397 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:48:15.596668 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:48:15.628846 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 16:48:15.655519 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 16:48:15.742084 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:48:15.774613 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 16:48:15.801145 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 16:48:16.391570 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2391 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 16:48:16.398081 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:16.410495 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 16:48:16.471697 tst emergency_mo_mt_call.py: using LAC 34943 16:48:16.593548 tst emergency_mo_mt_call.py: using RAC 8 16:48:16.752049 tst emergency_mo_mt_call.py: using CellId 34943 16:48:16.912844 tst emergency_mo_mt_call.py: using BVCI 34944 16:48:17.056729 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:17.068568 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:17.079881 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:17.091316 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:17.103421 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:17.115728 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:48:17.236138 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:48:17.356174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:17.832525 run create_hlr_db(pid=7560): Launched 16:48:17.958863 bus /sierra_2: Setting Powered False 16:48:19.019765 run create_hlr_db(pid=7560): Terminated: ok {rc=0} 16:48:19.448027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7562): Launched 16:48:19.756058 run osmo-hlr_10.42.42.2(pid=7563): Launched 16:48:19.873188 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:20.420157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7565): Launched 16:48:20.728813 run osmo-stp_10.42.42.5(pid=7566): Launched 16:48:20.855574 tst emergency_mo_mt_call.py: using MSISDN 8226 16:48:21.011724 run osmo-msc_10.42.42.6: Starting osmo-msc 16:48:21.563069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7568): Launched 16:48:21.871649 run osmo-msc_10.42.42.6(pid=7569): Launched 16:48:22.045213 run osmo-stp_10.42.42.5(pid=7566): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7566)] 16:48:22.175613 run osmo-stp_10.42.42.5(pid=7566): stdout: | (launched: 2022-12-13_16:48:20.671695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:22.305817 run osmo-stp_10.42.42.5(pid=7566): stderr: | [0;m[38;5;43m20221213164820845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164820845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164820845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164820846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164820846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164820846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164820846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:22.433182 run osmo-stp_10.42.42.5(pid=7566): stdout: | (launched: 2022-12-13_16:48:20.671695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:22.554802 run osmo-stp_10.42.42.5(pid=7566): stderr: | [0;m[38;5;43m20221213164820845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164820845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164820845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164820846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164820846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164820846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164820846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:22.700627 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7566): Process ended prematurely: osmo-stp_10.42.42.5(pid=7566) [trial-2391↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7566)] [trial-2391↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 16:48:22.709151 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 16:48:22.735487 run osmo-hlr_10.42.42.2(pid=7563): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7563)] 16:48:22.783760 run osmo-hlr_10.42.42.2(pid=7563): stdout: | (launched: 2022-12-13_16:48:19.698624) 16:48:22.833357 run osmo-hlr_10.42.42.2(pid=7563): stderr: | [0;m[1;31m20221213164819878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164819878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164819878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164819878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164819878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164819878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164819890 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164819899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164819900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164819900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:22.903038 run osmo-msc_10.42.42.6(pid=7569): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7569)] 16:48:22.950885 run osmo-msc_10.42.42.6(pid=7569): stdout: | (launched: 2022-12-13_16:48:21.814174) 16:48:23.000332 run osmo-msc_10.42.42.6(pid=7569): stderr: | [0;m[38;5;43m20221213164822089 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164822089 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7f74a95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164822089 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164822089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164822089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164822090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164822091 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164822092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164822092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164822092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:48:23.050162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7562): Terminating (SIGTERM) 16:48:23.090049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7565): Terminating (SIGTERM) 16:48:23.129719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7568): Terminating (SIGTERM) 16:48:23.169777 --- ParallelTerminationStrategy: PID 7562 died... 16:48:23.188378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7562): Terminated: ok {rc=0} 16:48:23.232436 --- ParallelTerminationStrategy: PID 7565 died... 16:48:23.251187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7565): Terminated: ok {rc=0} 16:48:23.295028 --- ParallelTerminationStrategy: PID 7568 died... 16:48:23.313829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7568): Terminated: ok {rc=0} 16:48:23.400088 bus /sierra_3: Setting Powered False 16:48:24.501224 bus /sierra_3: Setting Powered False 16:48:25.618598 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 16:48:26.706886 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:26.718521 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 16:48:26.768420 tst emergency_preemptive_call.py: using LAC 34944 16:48:26.889620 tst emergency_preemptive_call.py: using RAC 9 16:48:27.020845 tst emergency_preemptive_call.py: using CellId 34944 16:48:27.151843 tst emergency_preemptive_call.py: using BVCI 34945 16:48:27.272916 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:27.284360 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:27.295536 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:27.306804 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:27.318365 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:48:27.329929 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:48:27.448558 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:48:27.570976 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:48:27.688684 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:48:27.807101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:28.287934 run create_hlr_db(pid=7571): Launched 16:48:28.415349 bus /sierra_2: Setting Powered False 16:48:29.476650 run create_hlr_db(pid=7571): Terminated: ok {rc=0} 16:48:29.908938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7573): Launched 16:48:30.220780 run osmo-hlr_10.42.42.2(pid=7574): Launched 16:48:30.338083 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:30.916322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7576): Launched 16:48:31.259520 run osmo-stp_10.42.42.5(pid=7577): Launched 16:48:31.508518 tst emergency_preemptive_call.py: using MSISDN 8227 16:48:31.764508 run osmo-msc_10.42.42.6: Starting osmo-msc 16:48:32.361623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7579): Launched 16:48:32.691951 run osmo-msc_10.42.42.6(pid=7580): Launched 16:48:32.876022 run osmo-stp_10.42.42.5(pid=7577): ERR: Terminated: ERROR {rc=1} [trial-2391↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7577)] 16:48:33.014344 run osmo-stp_10.42.42.5(pid=7577): stdout: | (launched: 2022-12-13_16:48:31.200558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:33.153358 run osmo-stp_10.42.42.5(pid=7577): stderr: | [0;m[38;5;43m20221213164831526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164831526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164831526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164831537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164831537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164831537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164831537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:33.290687 run osmo-stp_10.42.42.5(pid=7577): stdout: | (launched: 2022-12-13_16:48:31.200558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:33.421487 run osmo-stp_10.42.42.5(pid=7577): stderr: | [0;m[38;5;43m20221213164831526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164831526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164831526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164831537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164831537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164831537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164831537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:33.577972 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7577): Process ended prematurely: osmo-stp_10.42.42.5(pid=7577) [trial-2391↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7577)] [trial-2391↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 16:48:33.587014 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 16:48:33.615076 run osmo-hlr_10.42.42.2(pid=7574): ERR: Terminated: ERROR {rc=237} [trial-2391↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7574)] 16:48:33.666266 run osmo-hlr_10.42.42.2(pid=7574): stdout: | (launched: 2022-12-13_16:48:30.162465) 16:48:33.718712 run osmo-hlr_10.42.42.2(pid=7574): stderr: | [0;m[1;31m20221213164830342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164830342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164830342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164830342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164830342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164830342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164830354 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164830364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164830364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164830364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:33.792572 run osmo-msc_10.42.42.6(pid=7580): ERR: Terminated: ERROR {rc=2} [trial-2391↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7580)] 16:48:33.843088 run osmo-msc_10.42.42.6(pid=7580): stdout: | (launched: 2022-12-13_16:48:32.630820) 16:48:33.895926 run osmo-msc_10.42.42.6(pid=7580): stderr: | [0;m[38;5;43m20221213164832953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213164832954 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb46b7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213164832954 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213164832954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213164832954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213164832954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213164832956 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213164832956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213164832956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213164832956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:48:33.949060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7573): Terminating (SIGTERM) 16:48:33.991097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7576): Terminating (SIGTERM) 16:48:34.034550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7579): Terminating (SIGTERM) 16:48:34.077661 --- ParallelTerminationStrategy: PID 7573 died... 16:48:34.098527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7573): Terminated: ok {rc=0} 16:48:34.146002 --- ParallelTerminationStrategy: PID 7576 died... 16:48:34.166221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7576): Terminated: ok {rc=0} 16:48:34.213233 --- ParallelTerminationStrategy: PID 7579 died... 16:48:34.233500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7579): Terminated: ok {rc=0} 16:48:34.323264 bus /sierra_9: Setting Powered False 16:48:35.422738 bus /sierra_9: Setting Powered False 16:48:36.539818 bus /sierra_8: Setting Powered False 16:48:37.638851 bus /sierra_8: Setting Powered False 16:48:38.755170 bus /sierra_3: Setting Powered False 16:48:39.853449 bus /sierra_3: Setting Powered False 16:48:40.971322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-900 --------------------------------------------------------------------- 16:48:42.251747 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:48:42.257257 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:48:42.289704 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 16:48:42.328672 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 16:48:42.421590 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:48:42.456516 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 16:48:42.496445 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 16:48:43.084585 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 16:48:43.139332 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:43.150692 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:48:43.201189 tst cs_paging_gprs_active.py: using LAC 34945 16:48:43.331156 tst cs_paging_gprs_active.py: using RAC 10 16:48:43.460387 tst cs_paging_gprs_active.py: using CellId 34945 16:48:43.591226 tst cs_paging_gprs_active.py: using BVCI 34946 16:48:43.712701 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:43.724099 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:43.735157 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:43.746269 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:43.757694 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:43.769500 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:43.781026 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:43.792250 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:43.803778 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:48:43.923450 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:48:44.047542 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:48:44.273994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:44.611212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7585): Launched 16:48:44.905421 run iperf3-srv_10.42.42.10(pid=7586): Launched 16:48:45.031030 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:48:45.256283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:45.591934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7587): Launched 16:48:45.913750 run iperf3-srv_10.42.42.10(pid=7588): Launched 16:48:46.048408 tst cs_paging_gprs_active.py:38: start network... 16:48:46.279197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:46.810088 run create_hlr_db(pid=7589): Launched 16:48:46.978159 bus /sierra_2: Setting Powered False 16:48:48.040107 run create_hlr_db(pid=7589): Terminated: ok {rc=0} 16:48:48.476890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7591): Launched 16:48:48.792500 run osmo-hlr_10.42.42.2(pid=7592): Launched 16:48:48.912361 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:49.455812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7594): Launched 16:48:49.770500 run osmo-stp_10.42.42.5(pid=7595): Launched 16:48:49.891757 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:50.434211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7597): Launched 16:48:50.554701 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:50.820482 run patchelf(pid=7598): Launched 16:48:50.996910 run osmo-stp_10.42.42.5(pid=7595): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7595)] 16:48:51.129677 run osmo-stp_10.42.42.5(pid=7595): stdout: | (launched: 2022-12-13_16:48:49.712353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:51.263538 run osmo-stp_10.42.42.5(pid=7595): stderr: | [0;m[38;5;43m20221213164849885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164849885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164849885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164849886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164849886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164849886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164849886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:51.397681 run osmo-stp_10.42.42.5(pid=7595): stdout: | (launched: 2022-12-13_16:48:49.712353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:51.525972 run osmo-stp_10.42.42.5(pid=7595): stderr: | [0;m[38;5;43m20221213164849885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164849885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164849885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164849886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164849886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164849886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164849886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:51.678035 run patchelf(pid=7598): Terminating (SIGINT) 16:48:51.854544 run patchelf(pid=7598): Terminated: ok {rc=0} 16:48:51.981671 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7595): Process ended prematurely: osmo-stp_10.42.42.5(pid=7595) [trial-2391↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7595)] [trial-2391↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 16:48:51.991279 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:48:52.018666 run osmo-hlr_10.42.42.2(pid=7592): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7592)] 16:48:52.066354 run osmo-hlr_10.42.42.2(pid=7592): stdout: | (launched: 2022-12-13_16:48:48.733572) 16:48:52.115790 run osmo-hlr_10.42.42.2(pid=7592): stderr: | [0;m[1;31m20221213164848918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164848918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164848918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164848918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164848918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164848918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164848930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164848939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164848939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164848939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:52.165477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7585): Terminating (SIGTERM) 16:48:52.205564 run iperf3-srv_10.42.42.10(pid=7586): Terminating (SIGTERM) 16:48:52.245328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7587): Terminating (SIGTERM) 16:48:52.285190 run iperf3-srv_10.42.42.10(pid=7588): Terminating (SIGTERM) 16:48:52.325019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7591): Terminating (SIGTERM) 16:48:52.365460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7594): Terminating (SIGTERM) 16:48:52.405232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7597): Terminating (SIGTERM) 16:48:52.445392 --- ParallelTerminationStrategy: PID 7585 died... 16:48:52.464122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7585): Terminated: ok {rc=0} 16:48:52.508367 --- ParallelTerminationStrategy: PID 7586 died... 16:48:52.527227 run iperf3-srv_10.42.42.10(pid=7586): Terminated {rc=256} 16:48:52.571224 --- ParallelTerminationStrategy: PID 7587 died... 16:48:52.590048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7587): Terminated: ok {rc=0} 16:48:52.634123 --- ParallelTerminationStrategy: PID 7588 died... 16:48:52.652825 run iperf3-srv_10.42.42.10(pid=7588): Terminated {rc=256} 16:48:52.697120 --- ParallelTerminationStrategy: PID 7591 died... 16:48:52.715981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7591): Terminated: ok {rc=0} 16:48:52.760209 --- ParallelTerminationStrategy: PID 7594 died... 16:48:52.778993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7594): Terminated: ok {rc=0} 16:48:52.823076 --- ParallelTerminationStrategy: PID 7597 died... 16:48:52.841808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7597): Terminated: ok {rc=0} 16:48:52.925647 bus /gobi_0: Setting Powered False 16:48:54.023901 bus /gobi_0: Setting Powered False 16:48:55.140553 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 16:48:56.292082 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:56.304062 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:48:56.357155 tst iperf3.py: using LAC 34946 16:48:56.488003 tst iperf3.py: using RAC 11 16:48:56.619948 tst iperf3.py: using CellId 34946 16:48:56.750229 tst iperf3.py: using BVCI 34947 16:48:56.872139 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:56.883592 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:56.894715 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:56.905897 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:56.917226 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:56.928594 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:56.940270 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:56.951582 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:48:56.963145 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:48:57.085255 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:48:57.295104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:57.611337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7599): Launched 16:48:57.887416 run iperf3-srv_10.42.42.10(pid=7600): Launched 16:48:58.005520 tst iperf3.py:8: start network... 16:48:58.215386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:58.701769 run create_hlr_db(pid=7601): Launched 16:48:58.830647 bus /gobi_6: Setting Powered False 16:48:59.892762 run create_hlr_db(pid=7601): Terminated: ok {rc=0} 16:49:00.350280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7603): Launched 16:49:00.687431 run osmo-hlr_10.42.42.2(pid=7604): Launched 16:49:00.818940 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:01.538573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7606): Launched 16:49:01.890447 run osmo-stp_10.42.42.5(pid=7607): Launched 16:49:02.142127 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:02.743839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7609): Launched 16:49:02.875226 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:03.159425 run patchelf(pid=7610): Launched 16:49:03.346410 run osmo-stp_10.42.42.5(pid=7607): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7607)] 16:49:03.488201 run osmo-stp_10.42.42.5(pid=7607): stdout: | (launched: 2022-12-13_16:49:01.827850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:03.632220 run osmo-stp_10.42.42.5(pid=7607): stderr: | [0;m[38;5;43m20221213164902126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164902126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164902127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164902127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164902127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164902128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164902128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:03.776561 run osmo-stp_10.42.42.5(pid=7607): stdout: | (launched: 2022-12-13_16:49:01.827850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:03.913851 run osmo-stp_10.42.42.5(pid=7607): stderr: | [0;m[38;5;43m20221213164902126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164902126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164902127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164902127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164902127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164902128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164902128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:04.076654 run patchelf(pid=7610): Terminating (SIGINT) 16:49:04.264565 run patchelf(pid=7610): Terminated: ok {rc=0} 16:49:04.400158 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7607): Process ended prematurely: osmo-stp_10.42.42.5(pid=7607) [trial-2391↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7607)] [trial-2391↪gprs:nanobts+band-900↪iperf3.py:8] 16:49:04.410742 tst iperf3.py:8: Test FAILED (8.2 sec) 16:49:04.439733 run osmo-hlr_10.42.42.2(pid=7604): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7604)] 16:49:04.491078 run osmo-hlr_10.42.42.2(pid=7604): stdout: | (launched: 2022-12-13_16:49:00.625716) 16:49:04.543569 run osmo-hlr_10.42.42.2(pid=7604): stderr: | [0;m[1;31m20221213164900826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164900826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164900826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164900826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164900826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164900826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164900843 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164900862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164900862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164900862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:04.596727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7599): Terminating (SIGTERM) 16:49:04.639036 run iperf3-srv_10.42.42.10(pid=7600): Terminating (SIGTERM) 16:49:04.681902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7603): Terminating (SIGTERM) 16:49:04.724345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7606): Terminating (SIGTERM) 16:49:04.766930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7609): Terminating (SIGTERM) 16:49:04.809891 --- ParallelTerminationStrategy: PID 7599 died... 16:49:04.830633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7599): Terminated: ok {rc=0} 16:49:04.877522 --- ParallelTerminationStrategy: PID 7600 died... 16:49:04.897515 run iperf3-srv_10.42.42.10(pid=7600): Terminated {rc=256} 16:49:04.943835 --- ParallelTerminationStrategy: PID 7603 died... 16:49:04.963829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7603): Terminated: ok {rc=0} 16:49:05.010351 --- ParallelTerminationStrategy: PID 7606 died... 16:49:05.030788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7606): Terminated: ok {rc=0} 16:49:05.077318 --- ParallelTerminationStrategy: PID 7609 died... 16:49:05.097771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7609): Terminated: ok {rc=0} 16:49:05.186643 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 16:49:06.334967 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:06.346647 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:49:06.394658 tst iperf3m4.py: using LAC 34947 16:49:06.520108 tst iperf3m4.py: using RAC 12 16:49:06.643127 tst iperf3m4.py: using CellId 34947 16:49:06.771076 tst iperf3m4.py: using BVCI 34948 16:49:06.886438 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:06.897349 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:06.907874 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:06.918583 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:06.929731 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:06.940860 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:06.952244 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:06.963322 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:06.974567 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:49:07.098102 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:49:07.220122 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:49:07.342019 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:49:07.460886 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:49:07.671952 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:07.987639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7611): Launched 16:49:08.262818 run iperf3-srv_10.42.42.10(pid=7612): Launched 16:49:08.382892 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:49:08.593249 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:08.908176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7613): Launched 16:49:09.183010 run iperf3-srv_10.42.42.10(pid=7614): Launched 16:49:09.300693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:49:09.510405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:09.825775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7615): Launched 16:49:10.101961 run iperf3-srv_10.42.42.10(pid=7616): Launched 16:49:10.218980 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:49:10.428148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:10.743362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7617): Launched 16:49:11.018978 run iperf3-srv_10.42.42.10(pid=7618): Launched 16:49:11.138263 tst iperf3m4.py:8: start network... 16:49:11.346971 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:11.832323 run create_hlr_db(pid=7619): Launched 16:49:11.960687 bus /gobi_6: Setting Powered False 16:49:13.023040 run create_hlr_db(pid=7619): Terminated: ok {rc=0} 16:49:13.479073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7621): Launched 16:49:13.815599 run osmo-hlr_10.42.42.2(pid=7622): Launched 16:49:13.938556 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:14.482627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7624): Launched 16:49:14.799339 run osmo-stp_10.42.42.5(pid=7625): Launched 16:49:14.918871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:15.459538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7627): Launched 16:49:15.581011 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:15.853710 run patchelf(pid=7628): Launched 16:49:16.074468 run osmo-stp_10.42.42.5(pid=7625): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7625)] 16:49:16.243124 run osmo-stp_10.42.42.5(pid=7625): stdout: | (launched: 2022-12-13_16:49:14.740346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:16.391228 run osmo-stp_10.42.42.5(pid=7625): stderr: | [0;m[38;5;43m20221213164914911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164914912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164914912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164914912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164914913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164914913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164914913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:16.540547 run osmo-stp_10.42.42.5(pid=7625): stdout: | (launched: 2022-12-13_16:49:14.740346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:16.707115 run osmo-stp_10.42.42.5(pid=7625): stderr: | [0;m[38;5;43m20221213164914911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164914912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164914912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164914912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164914913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164914913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164914913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:16.895570 run patchelf(pid=7628): Terminating (SIGINT) 16:49:17.091167 run patchelf(pid=7628): Terminated: ok {rc=0} 16:49:17.231312 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7625): Process ended prematurely: osmo-stp_10.42.42.5(pid=7625) [trial-2391↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7625)] [trial-2391↪gprs:nanobts+band-900↪iperf3m4.py:8] 16:49:17.242969 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:49:17.274753 run osmo-hlr_10.42.42.2(pid=7622): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7622)] 16:49:17.326654 run osmo-hlr_10.42.42.2(pid=7622): stdout: | (launched: 2022-12-13_16:49:13.753420) 16:49:17.379950 run osmo-hlr_10.42.42.2(pid=7622): stderr: | [0;m[1;31m20221213164913931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164913931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164913931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164913931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164913931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164913931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164913950 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164913960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164913961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164913961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:17.433727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7611): Terminating (SIGTERM) 16:49:17.476252 run iperf3-srv_10.42.42.10(pid=7612): Terminating (SIGTERM) 16:49:17.519152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7613): Terminating (SIGTERM) 16:49:17.562132 run iperf3-srv_10.42.42.10(pid=7614): Terminating (SIGTERM) 16:49:17.604699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7615): Terminating (SIGTERM) 16:49:17.647488 run iperf3-srv_10.42.42.10(pid=7616): Terminating (SIGTERM) 16:49:17.690426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7617): Terminating (SIGTERM) 16:49:17.733484 run iperf3-srv_10.42.42.10(pid=7618): Terminating (SIGTERM) 16:49:17.776320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7621): Terminating (SIGTERM) 16:49:17.819321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7624): Terminating (SIGTERM) 16:49:17.862301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7627): Terminating (SIGTERM) 16:49:17.905456 --- ParallelTerminationStrategy: PID 7611 died... 16:49:17.925892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7611): Terminated: ok {rc=0} 16:49:17.973231 --- ParallelTerminationStrategy: PID 7612 died... 16:49:17.993825 run iperf3-srv_10.42.42.10(pid=7612): Terminated {rc=256} 16:49:18.040930 --- ParallelTerminationStrategy: PID 7613 died... 16:49:18.061400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7613): Terminated: ok {rc=0} 16:49:18.108456 --- ParallelTerminationStrategy: PID 7614 died... 16:49:18.128881 run iperf3-srv_10.42.42.10(pid=7614): Terminated {rc=256} 16:49:18.175866 --- ParallelTerminationStrategy: PID 7615 died... 16:49:18.196197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7615): Terminated: ok {rc=0} 16:49:18.243314 --- ParallelTerminationStrategy: PID 7616 died... 16:49:18.263499 run iperf3-srv_10.42.42.10(pid=7616): Terminated {rc=256} 16:49:18.310268 --- ParallelTerminationStrategy: PID 7617 died... 16:49:18.330695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7617): Terminated: ok {rc=0} 16:49:18.377613 --- ParallelTerminationStrategy: PID 7618 died... 16:49:18.397917 run iperf3-srv_10.42.42.10(pid=7618): Terminated {rc=256} 16:49:18.444829 --- ParallelTerminationStrategy: PID 7621 died... 16:49:18.465740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7621): Terminated: ok {rc=0} 16:49:18.512843 --- ParallelTerminationStrategy: PID 7624 died... 16:49:18.533775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7624): Terminated: ok {rc=0} 16:49:18.581122 --- ParallelTerminationStrategy: PID 7627 died... 16:49:18.601544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7627): Terminated: ok {rc=0} 16:49:18.690664 bus /gobi_4: Setting Powered False 16:49:19.790255 bus /gobi_4: Setting Powered False 16:49:20.909167 bus /gobi_1: Setting Powered False 16:49:22.009119 bus /gobi_1: Setting Powered False 16:49:23.126385 bus /gobi_0: Setting Powered False 16:49:24.224834 bus /gobi_0: Setting Powered False 16:49:25.343691 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900 ping.py ---------------------------------------------- 16:49:26.446875 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:26.459050 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:49:26.508698 tst ping.py: using LAC 34948 16:49:26.630707 tst ping.py: using RAC 13 16:49:26.752780 tst ping.py: using CellId 34948 16:49:26.873172 tst ping.py: using BVCI 34949 16:49:26.985908 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:26.996674 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:27.007506 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:27.018235 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:27.028807 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:27.039507 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:27.050364 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:27.061072 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:49:27.182190 tst ping.py:19: start network... 16:49:27.404153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:27.913453 run create_hlr_db(pid=7629): Launched 16:49:28.039681 bus /gobi_6: Setting Powered False 16:49:29.106030 run create_hlr_db(pid=7629): Terminated: ok {rc=0} 16:49:29.562179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7631): Launched 16:49:29.893958 run osmo-hlr_10.42.42.2(pid=7632): Launched 16:49:30.020584 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:30.592550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7634): Launched 16:49:30.941809 run osmo-stp_10.42.42.5(pid=7635): Launched 16:49:31.178221 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:31.804808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7637): Launched 16:49:31.939366 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:32.216929 run patchelf(pid=7638): Launched 16:49:32.402163 run osmo-stp_10.42.42.5(pid=7635): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7635)] 16:49:32.533271 run osmo-stp_10.42.42.5(pid=7635): stdout: | (launched: 2022-12-13_16:49:30.864709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:32.666274 run osmo-stp_10.42.42.5(pid=7635): stderr: | [0;m[38;5;43m20221213164931148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164931149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164931149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164931149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164931150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164931150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164931150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:32.799103 run osmo-stp_10.42.42.5(pid=7635): stdout: | (launched: 2022-12-13_16:49:30.864709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:32.924531 run osmo-stp_10.42.42.5(pid=7635): stderr: | [0;m[38;5;43m20221213164931148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164931149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164931149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164931149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164931150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164931150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164931150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:33.073882 run patchelf(pid=7638): Terminating (SIGINT) 16:49:33.247140 run patchelf(pid=7638): Terminated: ok {rc=0} 16:49:33.371508 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7635): Process ended prematurely: osmo-stp_10.42.42.5(pid=7635) [trial-2391↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7635)] [trial-2391↪gprs:nanobts+band-900↪ping.py:22] 16:49:33.380619 tst ping.py:22: Test FAILED (6.9 sec) 16:49:33.407949 run osmo-hlr_10.42.42.2(pid=7632): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7632)] 16:49:33.456715 run osmo-hlr_10.42.42.2(pid=7632): stdout: | (launched: 2022-12-13_16:49:29.832600) 16:49:33.506929 run osmo-hlr_10.42.42.2(pid=7632): stderr: | [0;m[1;31m20221213164930032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164930032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164930032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164930032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164930032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164930032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164930044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164930053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164930053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164930053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:33.557686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7631): Terminating (SIGTERM) 16:49:33.598212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7634): Terminating (SIGTERM) 16:49:33.638746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7637): Terminating (SIGTERM) 16:49:33.679495 --- ParallelTerminationStrategy: PID 7631 died... 16:49:33.698929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7631): Terminated: ok {rc=0} 16:49:33.743551 --- ParallelTerminationStrategy: PID 7634 died... 16:49:33.762651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7634): Terminated: ok {rc=0} 16:49:33.807224 --- ParallelTerminationStrategy: PID 7637 died... 16:49:33.826202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7637): Terminated: ok {rc=0} 16:49:33.912861 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 16:49:35.002471 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:35.014504 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:49:35.064523 tst ping_idle_ping.py: using LAC 34949 16:49:35.185033 tst ping_idle_ping.py: using RAC 14 16:49:35.307119 tst ping_idle_ping.py: using CellId 34949 16:49:35.428379 tst ping_idle_ping.py: using BVCI 34950 16:49:35.539969 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:35.550834 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:35.561713 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:35.572438 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:35.583022 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:35.593705 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:35.604410 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:49:35.615607 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:49:35.736699 tst ping_idle_ping.py:24: start network... 16:49:35.960080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:36.474354 run create_hlr_db(pid=7640): Launched 16:49:36.603425 bus /gobi_6: Setting Powered False 16:49:37.668837 run create_hlr_db(pid=7640): Terminated: ok {rc=0} 16:49:38.112624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7642): Launched 16:49:38.423301 run osmo-hlr_10.42.42.2(pid=7643): Launched 16:49:38.541552 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:39.075972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7645): Launched 16:49:39.387719 run osmo-stp_10.42.42.5(pid=7646): Launched 16:49:39.504685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:40.038492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7648): Launched 16:49:40.157598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:40.420071 run patchelf(pid=7649): Launched 16:49:40.592125 run osmo-stp_10.42.42.5(pid=7646): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7646)] 16:49:40.723647 run osmo-stp_10.42.42.5(pid=7646): stdout: | (launched: 2022-12-13_16:49:39.328928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:40.856073 run osmo-stp_10.42.42.5(pid=7646): stderr: | [0;m[38;5;43m20221213164939502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164939502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164939503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164939503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164939504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164939504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164939504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:40.988770 run osmo-stp_10.42.42.5(pid=7646): stdout: | (launched: 2022-12-13_16:49:39.328928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:41.114971 run osmo-stp_10.42.42.5(pid=7646): stderr: | [0;m[38;5;43m20221213164939502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164939502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164939503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164939503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164939504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164939504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164939504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:41.264533 run patchelf(pid=7649): Terminating (SIGINT) 16:49:41.437708 run patchelf(pid=7649): Terminated: ok {rc=0} 16:49:41.562337 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7646): Process ended prematurely: osmo-stp_10.42.42.5(pid=7646) [trial-2391↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7646)] [trial-2391↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 16:49:41.571371 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:49:41.598587 run osmo-hlr_10.42.42.2(pid=7643): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7643)] 16:49:41.646380 run osmo-hlr_10.42.42.2(pid=7643): stdout: | (launched: 2022-12-13_16:49:38.365060) 16:49:41.695856 run osmo-hlr_10.42.42.2(pid=7643): stderr: | [0;m[1;31m20221213164938543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164938543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164938543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164938543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164938543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164938544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164938555 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164938564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164938564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164938564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:41.745778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7642): Terminating (SIGTERM) 16:49:41.785885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7645): Terminating (SIGTERM) 16:49:41.826072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7648): Terminating (SIGTERM) 16:49:41.866699 --- ParallelTerminationStrategy: PID 7642 died... 16:49:41.886227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7642): Terminated: ok {rc=0} 16:49:41.930672 --- ParallelTerminationStrategy: PID 7645 died... 16:49:41.949572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7645): Terminated: ok {rc=0} 16:49:41.993963 --- ParallelTerminationStrategy: PID 7648 died... 16:49:42.012937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7648): Terminated: ok {rc=0} 16:49:42.098087 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 16:49:43.403985 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:49:43.411682 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:49:43.444114 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:49:43.483257 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:49:43.572012 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:49:43.605859 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:49:43.646867 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:49:44.247875 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:49:44.302240 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:44.313720 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:49:44.363822 tst cs_paging_gprs_active.py: using LAC 34950 16:49:44.495628 tst cs_paging_gprs_active.py: using RAC 15 16:49:44.625699 tst cs_paging_gprs_active.py: using CellId 34950 16:49:44.755016 tst cs_paging_gprs_active.py: using BVCI 34951 16:49:44.879312 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:44.891065 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:44.902640 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:44.914149 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:44.926072 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:44.938060 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:44.950096 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:44.961854 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:44.974119 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:49:45.094272 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:49:45.217876 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:49:45.444918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:45.783077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7653): Launched 16:49:46.131667 run iperf3-srv_10.42.42.10(pid=7654): Launched 16:49:46.254114 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:49:46.486588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:46.832173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7655): Launched 16:49:47.141746 run iperf3-srv_10.42.42.10(pid=7656): Launched 16:49:47.271089 tst cs_paging_gprs_active.py:38: start network... 16:49:47.481840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:47.968725 run create_hlr_db(pid=7657): Launched 16:49:48.096934 bus /gobi_6: Setting Powered False 16:49:49.158650 run create_hlr_db(pid=7657): Terminated: ok {rc=0} 16:49:49.616381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7659): Launched 16:49:49.954198 run osmo-hlr_10.42.42.2(pid=7660): Launched 16:49:50.082200 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:50.659038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7662): Launched 16:49:50.996155 run osmo-stp_10.42.42.5(pid=7663): Launched 16:49:51.125697 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:51.706322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7665): Launched 16:49:51.835858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:52.121079 run patchelf(pid=7666): Launched 16:49:52.308116 run osmo-stp_10.42.42.5(pid=7663): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7663)] 16:49:52.450197 run osmo-stp_10.42.42.5(pid=7663): stdout: | (launched: 2022-12-13_16:49:50.933903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:52.593982 run osmo-stp_10.42.42.5(pid=7663): stderr: | [0;m[38;5;43m20221213164951129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164951129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164951129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164951130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164951130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164951130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164951130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:52.737245 run osmo-stp_10.42.42.5(pid=7663): stdout: | (launched: 2022-12-13_16:49:50.933903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:52.874963 run osmo-stp_10.42.42.5(pid=7663): stderr: | [0;m[38;5;43m20221213164951129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213164951129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213164951129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213164951130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213164951130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213164951130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213164951130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:53.037228 run patchelf(pid=7666): Terminating (SIGINT) 16:49:53.225281 run patchelf(pid=7666): Terminated: ok {rc=0} 16:49:53.360662 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7663): Process ended prematurely: osmo-stp_10.42.42.5(pid=7663) [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7663)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:49:53.371133 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 16:49:53.400222 run osmo-hlr_10.42.42.2(pid=7660): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7660)] 16:49:53.451981 run osmo-hlr_10.42.42.2(pid=7660): stdout: | (launched: 2022-12-13_16:49:49.891776) 16:49:53.504723 run osmo-hlr_10.42.42.2(pid=7660): stderr: | [0;m[1;31m20221213164950092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213164950092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213164950092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213164950092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213164950092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213164950092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213164950104 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213164950113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213164950113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213164950113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:53.557983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7653): Terminating (SIGTERM) 16:49:53.600585 run iperf3-srv_10.42.42.10(pid=7654): Terminating (SIGTERM) 16:49:53.643457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7655): Terminating (SIGTERM) 16:49:53.686538 run iperf3-srv_10.42.42.10(pid=7656): Terminating (SIGTERM) 16:49:53.729746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7659): Terminating (SIGTERM) 16:49:53.772664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7662): Terminating (SIGTERM) 16:49:53.815850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7665): Terminating (SIGTERM) 16:49:53.858979 --- ParallelTerminationStrategy: PID 7653 died... 16:49:53.879811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7653): Terminated: ok {rc=0} 16:49:53.927528 --- ParallelTerminationStrategy: PID 7654 died... 16:49:53.947832 run iperf3-srv_10.42.42.10(pid=7654): Terminated {rc=256} 16:49:53.994705 --- ParallelTerminationStrategy: PID 7655 died... 16:49:54.015031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7655): Terminated: ok {rc=0} 16:49:54.061889 --- ParallelTerminationStrategy: PID 7656 died... 16:49:54.081880 run iperf3-srv_10.42.42.10(pid=7656): Terminated {rc=256} 16:49:54.128686 --- ParallelTerminationStrategy: PID 7659 died... 16:49:54.149025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7659): Terminated: ok {rc=0} 16:49:54.195692 --- ParallelTerminationStrategy: PID 7662 died... 16:49:54.216029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7662): Terminated: ok {rc=0} 16:49:54.262926 --- ParallelTerminationStrategy: PID 7665 died... 16:49:54.282892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7665): Terminated: ok {rc=0} 16:49:54.371791 bus /gobi_0: Setting Powered False 16:49:55.471734 bus /gobi_0: Setting Powered False 16:49:56.589619 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:49:57.737541 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:57.749413 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:49:57.804052 tst iperf3.py: using LAC 34951 16:49:57.926441 tst iperf3.py: using RAC 16 16:49:58.047349 tst iperf3.py: using CellId 34951 16:49:58.169810 tst iperf3.py: using BVCI 34952 16:49:58.283547 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:58.294929 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:58.306026 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:58.317220 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:58.328196 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:58.339297 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:58.350642 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:58.361701 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:49:58.372750 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:49:58.494117 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:49:58.706510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:59.023718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7667): Launched 16:49:59.298659 run iperf3-srv_10.42.42.10(pid=7668): Launched 16:49:59.417446 tst iperf3.py:8: start network... 16:49:59.628133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:00.116242 run create_hlr_db(pid=7669): Launched 16:50:00.244344 bus /gobi_6: Setting Powered False 16:50:01.328791 run create_hlr_db(pid=7669): Terminated: ok {rc=0} 16:50:01.845325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7671): Launched 16:50:02.197964 run osmo-hlr_10.42.42.2(pid=7675): Launched 16:50:02.362604 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:02.911141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7677): Launched 16:50:03.227553 run osmo-stp_10.42.42.5(pid=7678): Launched 16:50:03.347105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:03.890916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7680): Launched 16:50:04.011871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:04.279365 run patchelf(pid=7681): Launched 16:50:04.455083 run osmo-stp_10.42.42.5(pid=7678): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7678)] 16:50:04.587923 run osmo-stp_10.42.42.5(pid=7678): stdout: | (launched: 2022-12-13_16:50:03.168353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:04.723060 run osmo-stp_10.42.42.5(pid=7678): stderr: | [0;m[38;5;43m20221213165003340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165003340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165003340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165003341 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165003341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165003341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165003341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:04.857633 run osmo-stp_10.42.42.5(pid=7678): stdout: | (launched: 2022-12-13_16:50:03.168353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:04.986369 run osmo-stp_10.42.42.5(pid=7678): stderr: | [0;m[38;5;43m20221213165003340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165003340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165003340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165003341 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165003341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165003341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165003341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:05.138567 run patchelf(pid=7681): Terminating (SIGINT) 16:50:05.315092 run patchelf(pid=7681): Terminated: ok {rc=0} 16:50:05.442162 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7678): Process ended prematurely: osmo-stp_10.42.42.5(pid=7678) [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7678)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 16:50:05.451945 tst iperf3.py:8: Test FAILED (7.8 sec) 16:50:05.479769 run osmo-hlr_10.42.42.2(pid=7675): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7675)] 16:50:05.527693 run osmo-hlr_10.42.42.2(pid=7675): stdout: | (launched: 2022-12-13_16:50:02.131016) 16:50:05.577420 run osmo-hlr_10.42.42.2(pid=7675): stderr: | [0;m[1;31m20221213165002368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165002368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165002368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165002368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165002368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165002368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165002380 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165002389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165002389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165002389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:05.627563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7667): Terminating (SIGTERM) 16:50:05.667773 run iperf3-srv_10.42.42.10(pid=7668): Terminating (SIGTERM) 16:50:05.708155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7671): Terminating (SIGTERM) 16:50:05.748467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7677): Terminating (SIGTERM) 16:50:05.788598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7680): Terminating (SIGTERM) 16:50:05.829377 --- ParallelTerminationStrategy: PID 7667 died... 16:50:05.849044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7667): Terminated: ok {rc=0} 16:50:05.893647 --- ParallelTerminationStrategy: PID 7668 died... 16:50:05.912725 run iperf3-srv_10.42.42.10(pid=7668): Terminated {rc=256} 16:50:05.957307 --- ParallelTerminationStrategy: PID 7671 died... 16:50:05.976037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7671): Terminated: ok {rc=0} 16:50:06.020698 --- ParallelTerminationStrategy: PID 7677 died... 16:50:06.039741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7677): Terminated: ok {rc=0} 16:50:06.084157 --- ParallelTerminationStrategy: PID 7680 died... 16:50:06.103254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7680): Terminated: ok {rc=0} 16:50:06.191004 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:50:07.341886 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:07.353854 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:50:07.404039 tst iperf3m4.py: using LAC 34952 16:50:07.526924 tst iperf3m4.py: using RAC 17 16:50:07.650439 tst iperf3m4.py: using CellId 34952 16:50:07.774920 tst iperf3m4.py: using BVCI 34953 16:50:07.900300 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:07.912089 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:07.923733 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:07.935061 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:07.947628 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:07.959867 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:07.972539 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:07.984727 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:07.997054 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:50:08.119184 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:50:08.245440 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:50:08.364672 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:50:08.488719 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:50:08.715444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:09.053480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7682): Launched 16:50:09.347732 run iperf3-srv_10.42.42.10(pid=7683): Launched 16:50:09.474656 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:50:09.701479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:10.040907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7684): Launched 16:50:10.334470 run iperf3-srv_10.42.42.10(pid=7685): Launched 16:50:10.461460 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:50:10.687637 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:11.027418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7686): Launched 16:50:11.321467 run iperf3-srv_10.42.42.10(pid=7687): Launched 16:50:11.448077 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:50:11.674400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:12.013380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7688): Launched 16:50:12.307280 run iperf3-srv_10.42.42.10(pid=7689): Launched 16:50:12.433573 tst iperf3m4.py:8: start network... 16:50:12.659680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:13.181541 run create_hlr_db(pid=7690): Launched 16:50:13.309435 bus /gobi_6: Setting Powered False 16:50:14.375465 run create_hlr_db(pid=7690): Terminated: ok {rc=0} 16:50:14.824000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7692): Launched 16:50:15.141314 run osmo-hlr_10.42.42.2(pid=7693): Launched 16:50:15.261011 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:15.803649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7695): Launched 16:50:16.187425 run osmo-stp_10.42.42.5(pid=7696): Launched 16:50:16.430560 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:17.166623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7698): Launched 16:50:17.301591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:17.572493 run patchelf(pid=7699): Launched 16:50:17.748395 run osmo-stp_10.42.42.5(pid=7696): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7696)] 16:50:17.881392 run osmo-stp_10.42.42.5(pid=7696): stdout: | (launched: 2022-12-13_16:50:16.125343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:18.016328 run osmo-stp_10.42.42.5(pid=7696): stderr: | [0;m[38;5;43m20221213165016359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165016359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165016360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165016360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165016363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165016365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165016366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:18.151437 run osmo-stp_10.42.42.5(pid=7696): stdout: | (launched: 2022-12-13_16:50:16.125343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:18.279726 run osmo-stp_10.42.42.5(pid=7696): stderr: | [0;m[38;5;43m20221213165016359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165016359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165016360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165016360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165016363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165016365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165016366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:18.431881 run patchelf(pid=7699): Terminating (SIGINT) 16:50:18.608598 run patchelf(pid=7699): Terminated: ok {rc=0} 16:50:18.736321 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7696): Process ended prematurely: osmo-stp_10.42.42.5(pid=7696) [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7696)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 16:50:18.746097 tst iperf3m4.py:8: Test FAILED (11.4 sec) 16:50:18.774249 run osmo-hlr_10.42.42.2(pid=7693): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7693)] 16:50:18.823042 run osmo-hlr_10.42.42.2(pid=7693): stdout: | (launched: 2022-12-13_16:50:15.082308) 16:50:18.873669 run osmo-hlr_10.42.42.2(pid=7693): stderr: | [0;m[1;31m20221213165015259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165015259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165015259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165015259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165015259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165015259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165015271 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165015279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165015280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165015280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:18.924327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7682): Terminating (SIGTERM) 16:50:18.965180 run iperf3-srv_10.42.42.10(pid=7683): Terminating (SIGTERM) 16:50:19.005810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7684): Terminating (SIGTERM) 16:50:19.046878 run iperf3-srv_10.42.42.10(pid=7685): Terminating (SIGTERM) 16:50:19.087028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7686): Terminating (SIGTERM) 16:50:19.127066 run iperf3-srv_10.42.42.10(pid=7687): Terminating (SIGTERM) 16:50:19.166961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7688): Terminating (SIGTERM) 16:50:19.206906 run iperf3-srv_10.42.42.10(pid=7689): Terminating (SIGTERM) 16:50:19.246768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7692): Terminating (SIGTERM) 16:50:19.286941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7695): Terminating (SIGTERM) 16:50:19.326915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7698): Terminating (SIGTERM) 16:50:19.367309 --- ParallelTerminationStrategy: PID 7682 died... 16:50:19.386957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7682): Terminated: ok {rc=0} 16:50:19.431578 --- ParallelTerminationStrategy: PID 7683 died... 16:50:19.450817 run iperf3-srv_10.42.42.10(pid=7683): Terminated {rc=256} 16:50:19.495029 --- ParallelTerminationStrategy: PID 7684 died... 16:50:19.514089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7684): Terminated: ok {rc=0} 16:50:19.558264 --- ParallelTerminationStrategy: PID 7685 died... 16:50:19.577421 run iperf3-srv_10.42.42.10(pid=7685): Terminated {rc=256} 16:50:19.621519 --- ParallelTerminationStrategy: PID 7686 died... 16:50:19.640499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7686): Terminated: ok {rc=0} 16:50:19.684793 --- ParallelTerminationStrategy: PID 7687 died... 16:50:19.704161 run iperf3-srv_10.42.42.10(pid=7687): Terminated {rc=256} 16:50:19.748351 --- ParallelTerminationStrategy: PID 7688 died... 16:50:19.767542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7688): Terminated: ok {rc=0} 16:50:19.811763 --- ParallelTerminationStrategy: PID 7689 died... 16:50:19.830915 run iperf3-srv_10.42.42.10(pid=7689): Terminated {rc=256} 16:50:19.875373 --- ParallelTerminationStrategy: PID 7692 died... 16:50:19.894458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7692): Terminated: ok {rc=0} 16:50:19.938861 --- ParallelTerminationStrategy: PID 7695 died... 16:50:19.957889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7695): Terminated: ok {rc=0} 16:50:20.002107 --- ParallelTerminationStrategy: PID 7698 died... 16:50:20.021247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7698): Terminated: ok {rc=0} 16:50:20.108065 bus /gobi_4: Setting Powered False 16:50:21.208553 bus /gobi_4: Setting Powered False 16:50:22.326140 bus /gobi_1: Setting Powered False 16:50:23.425238 bus /gobi_1: Setting Powered False 16:50:24.542268 bus /gobi_0: Setting Powered False 16:50:25.641602 bus /gobi_0: Setting Powered False 16:50:26.759055 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 16:50:27.862185 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:27.874722 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:50:27.926837 tst ping.py: using LAC 34953 16:50:28.058787 tst ping.py: using RAC 18 16:50:28.200522 tst ping.py: using CellId 34953 16:50:28.330383 tst ping.py: using BVCI 34954 16:50:28.451806 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:28.463494 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:28.475096 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:28.486814 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:28.498482 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:28.510168 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:28.522174 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:28.533974 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:50:28.655787 tst ping.py:19: start network... 16:50:28.876761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:29.383177 run create_hlr_db(pid=7700): Launched 16:50:29.508596 bus /gobi_6: Setting Powered False 16:50:30.573437 run create_hlr_db(pid=7700): Terminated: ok {rc=0} 16:50:31.034818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7702): Launched 16:50:31.369758 run osmo-hlr_10.42.42.2(pid=7703): Launched 16:50:31.599533 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:32.320088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7705): Launched 16:50:32.693489 run osmo-stp_10.42.42.5(pid=7706): Launched 16:50:32.819766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:33.358770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7708): Launched 16:50:33.476804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:33.741584 run patchelf(pid=7709): Launched 16:50:33.925910 run osmo-stp_10.42.42.5(pid=7706): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7706)] 16:50:34.065399 run osmo-stp_10.42.42.5(pid=7706): stdout: | (launched: 2022-12-13_16:50:32.632003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:34.206858 run osmo-stp_10.42.42.5(pid=7706): stderr: | [0;m[38;5;43m20221213165032826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165032826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165032826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165032827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165032827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165032827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165032828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:34.348794 run osmo-stp_10.42.42.5(pid=7706): stdout: | (launched: 2022-12-13_16:50:32.632003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:34.483344 run osmo-stp_10.42.42.5(pid=7706): stderr: | [0;m[38;5;43m20221213165032826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165032826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165032826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165032827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165032827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165032827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165032828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:34.643092 run patchelf(pid=7709): Terminating (SIGINT) 16:50:34.828123 run patchelf(pid=7709): Terminated: ok {rc=0} 16:50:34.961189 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7706): Process ended prematurely: osmo-stp_10.42.42.5(pid=7706) [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7706)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 16:50:34.971049 tst ping.py:22: Test FAILED (7.1 sec) 16:50:34.999645 run osmo-hlr_10.42.42.2(pid=7703): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7703)] 16:50:35.051225 run osmo-hlr_10.42.42.2(pid=7703): stdout: | (launched: 2022-12-13_16:50:31.305498) 16:50:35.104386 run osmo-hlr_10.42.42.2(pid=7703): stderr: | [0;m[1;31m20221213165031660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165031660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165031660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165031660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165031660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165031660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165031675 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165031691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165031692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165031692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:35.157584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7702): Terminating (SIGTERM) 16:50:35.199905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7705): Terminating (SIGTERM) 16:50:35.243135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7708): Terminating (SIGTERM) 16:50:35.286092 --- ParallelTerminationStrategy: PID 7702 died... 16:50:35.306827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7702): Terminated: ok {rc=0} 16:50:35.353963 --- ParallelTerminationStrategy: PID 7705 died... 16:50:35.374304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7705): Terminated: ok {rc=0} 16:50:35.421188 --- ParallelTerminationStrategy: PID 7708 died... 16:50:35.441849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7708): Terminated: ok {rc=0} 16:50:35.531420 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:50:36.619720 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:36.632227 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:50:36.686193 tst ping_idle_ping.py: using LAC 34954 16:50:36.817220 tst ping_idle_ping.py: using RAC 19 16:50:36.947375 tst ping_idle_ping.py: using CellId 34954 16:50:37.081283 tst ping_idle_ping.py: using BVCI 34955 16:50:37.203549 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:37.215279 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:37.226757 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:37.238254 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:37.250430 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:37.262558 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:37.275205 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:50:37.287551 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:50:37.408046 tst ping_idle_ping.py:24: start network... 16:50:37.615389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:38.096890 run create_hlr_db(pid=7710): Launched 16:50:38.224596 bus /gobi_6: Setting Powered False 16:50:39.289301 run create_hlr_db(pid=7710): Terminated: ok {rc=0} 16:50:39.733889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7712): Launched 16:50:40.044910 run osmo-hlr_10.42.42.2(pid=7713): Launched 16:50:40.163772 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:40.700202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7715): Launched 16:50:41.011345 run osmo-stp_10.42.42.5(pid=7716): Launched 16:50:41.130548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:41.664920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7718): Launched 16:50:41.783883 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:42.046452 run patchelf(pid=7719): Launched 16:50:42.219489 run osmo-stp_10.42.42.5(pid=7716): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7716)] 16:50:42.351221 run osmo-stp_10.42.42.5(pid=7716): stdout: | (launched: 2022-12-13_16:50:40.953311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:42.485052 run osmo-stp_10.42.42.5(pid=7716): stderr: | [0;m[38;5;43m20221213165041124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165041124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165041124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165041125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165041125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165041125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165041125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:42.618668 run osmo-stp_10.42.42.5(pid=7716): stdout: | (launched: 2022-12-13_16:50:40.953311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:42.745736 run osmo-stp_10.42.42.5(pid=7716): stderr: | [0;m[38;5;43m20221213165041124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165041124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165041124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165041125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165041125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165041125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165041125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:42.896053 run patchelf(pid=7719): Terminating (SIGINT) 16:50:43.070554 run patchelf(pid=7719): Terminated: ok {rc=0} 16:50:43.196367 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7716): Process ended prematurely: osmo-stp_10.42.42.5(pid=7716) [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7716)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 16:50:43.205622 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:50:43.233540 run osmo-hlr_10.42.42.2(pid=7713): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7713)] 16:50:43.282209 run osmo-hlr_10.42.42.2(pid=7713): stdout: | (launched: 2022-12-13_16:50:39.986659) 16:50:43.332304 run osmo-hlr_10.42.42.2(pid=7713): stderr: | [0;m[1;31m20221213165040166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165040166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165040166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165040166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165040166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165040166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165040179 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165040187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165040188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165040188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:43.382914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7712): Terminating (SIGTERM) 16:50:43.423429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7715): Terminating (SIGTERM) 16:50:43.463750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7718): Terminating (SIGTERM) 16:50:43.504498 --- ParallelTerminationStrategy: PID 7712 died... 16:50:43.524248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7712): Terminated: ok {rc=0} 16:50:43.569256 --- ParallelTerminationStrategy: PID 7715 died... 16:50:43.588378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7715): Terminated: ok {rc=0} 16:50:43.633019 --- ParallelTerminationStrategy: PID 7718 died... 16:50:43.652075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7718): Terminated: ok {rc=0} 16:50:43.739051 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:50:45.047959 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:50:45.055524 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:50:45.088714 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:50:45.127697 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:50:45.216326 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:50:45.251005 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:50:45.292457 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:50:45.884813 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:50:45.943257 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:50:45.955341 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:50:46.031891 tst cs_paging_gprs_active.py: using LAC 34955 16:50:46.164465 tst cs_paging_gprs_active.py: using RAC 20 16:50:46.297578 tst cs_paging_gprs_active.py: using CellId 34955 16:50:46.429318 tst cs_paging_gprs_active.py: using BVCI 34956 16:50:46.594144 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:50:46.610219 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:50:46.625862 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:50:46.639160 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:50:46.652275 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:50:46.664860 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:50:46.677875 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:50:46.690973 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:50:46.703911 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:50:46.829317 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:50:46.972061 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:50:47.189393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:47.510370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7724): Launched 16:50:47.789856 run iperf3-srv_10.42.42.10(pid=7725): Launched 16:50:47.919084 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:50:48.147125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:48.486802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7726): Launched 16:50:48.781311 run iperf3-srv_10.42.42.10(pid=7727): Launched 16:50:48.908103 tst cs_paging_gprs_active.py:38: start network... 16:50:49.134662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:49.654896 run create_hlr_db(pid=7728): Launched 16:50:49.784124 bus /gobi_6: Setting Powered False 16:50:50.849806 run create_hlr_db(pid=7728): Terminated: ok {rc=0} 16:50:51.315691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7730): Launched 16:50:51.652008 run osmo-hlr_10.42.42.2(pid=7731): Launched 16:50:51.780677 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:52.370878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7733): Launched 16:50:52.707393 run osmo-stp_10.42.42.5(pid=7734): Launched 16:50:52.839615 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:53.419851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7736): Launched 16:50:53.550569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:53.834905 run patchelf(pid=7737): Launched 16:50:54.021887 run osmo-stp_10.42.42.5(pid=7734): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7734)] 16:50:54.163902 run osmo-stp_10.42.42.5(pid=7734): stdout: | (launched: 2022-12-13_16:50:52.645058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:54.306964 run osmo-stp_10.42.42.5(pid=7734): stderr: | [0;m[38;5;43m20221213165052838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165052839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165052839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165052839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165052840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165052840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165052840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:54.450286 run osmo-stp_10.42.42.5(pid=7734): stdout: | (launched: 2022-12-13_16:50:52.645058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:54.587173 run osmo-stp_10.42.42.5(pid=7734): stderr: | [0;m[38;5;43m20221213165052838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165052839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165052839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165052839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165052840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165052840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165052840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:54.749818 run patchelf(pid=7737): Terminating (SIGINT) 16:50:54.938623 run patchelf(pid=7737): Terminated: ok {rc=0} 16:50:55.074145 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7734): Process ended prematurely: osmo-stp_10.42.42.5(pid=7734) [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7734)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:50:55.084679 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 16:50:55.113828 run osmo-hlr_10.42.42.2(pid=7731): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7731)] 16:50:55.164476 run osmo-hlr_10.42.42.2(pid=7731): stdout: | (launched: 2022-12-13_16:50:51.590012) 16:50:55.216594 run osmo-hlr_10.42.42.2(pid=7731): stderr: | [0;m[1;31m20221213165051789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165051789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165051789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165051789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165051789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165051789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165051806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165051817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165051817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165051817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:55.269716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7724): Terminating (SIGTERM) 16:50:55.312071 run iperf3-srv_10.42.42.10(pid=7725): Terminating (SIGTERM) 16:50:55.355011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7726): Terminating (SIGTERM) 16:50:55.397578 run iperf3-srv_10.42.42.10(pid=7727): Terminating (SIGTERM) 16:50:55.440333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7730): Terminating (SIGTERM) 16:50:55.482882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7733): Terminating (SIGTERM) 16:50:55.525838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7736): Terminating (SIGTERM) 16:50:55.568796 --- ParallelTerminationStrategy: PID 7724 died... 16:50:55.589471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7724): Terminated: ok {rc=0} 16:50:55.636200 --- ParallelTerminationStrategy: PID 7725 died... 16:50:55.656203 run iperf3-srv_10.42.42.10(pid=7725): Terminated {rc=256} 16:50:55.702880 --- ParallelTerminationStrategy: PID 7726 died... 16:50:55.722998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7726): Terminated: ok {rc=0} 16:50:55.769645 --- ParallelTerminationStrategy: PID 7727 died... 16:50:55.789659 run iperf3-srv_10.42.42.10(pid=7727): Terminated {rc=256} 16:50:55.836408 --- ParallelTerminationStrategy: PID 7730 died... 16:50:55.856313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7730): Terminated: ok {rc=0} 16:50:55.903316 --- ParallelTerminationStrategy: PID 7733 died... 16:50:55.923515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7733): Terminated: ok {rc=0} 16:50:55.970184 --- ParallelTerminationStrategy: PID 7736 died... 16:50:55.990282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7736): Terminated: ok {rc=0} 16:50:56.079240 bus /gobi_0: Setting Powered False 16:50:57.179245 bus /gobi_0: Setting Powered False 16:50:58.297200 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:50:59.448435 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:50:59.460725 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:50:59.534667 tst iperf3.py: using LAC 34956 16:50:59.666831 tst iperf3.py: using RAC 21 16:50:59.790905 tst iperf3.py: using CellId 34956 16:50:59.916078 tst iperf3.py: using BVCI 34957 16:51:00.031918 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:00.043235 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:00.054421 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:00.065527 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:00.076441 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:00.087502 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:00.098646 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:00.109694 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:00.120767 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:51:00.242724 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:51:00.470356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:51:00.809094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7738): Launched 16:51:01.116098 run iperf3-srv_10.42.42.10(pid=7739): Launched 16:51:01.254481 tst iperf3.py:8: start network... 16:51:01.476514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:01.986093 run create_hlr_db(pid=7740): Launched 16:51:02.146153 bus /gobi_6: Setting Powered False 16:51:03.208496 run create_hlr_db(pid=7740): Terminated: ok {rc=0} 16:51:03.668894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7742): Launched 16:51:04.008366 run osmo-hlr_10.42.42.2(pid=7743): Launched 16:51:04.137469 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:04.715701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7745): Launched 16:51:05.052251 run osmo-stp_10.42.42.5(pid=7746): Launched 16:51:05.180523 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:51:05.758976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7748): Launched 16:51:05.888899 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:51:06.174186 run patchelf(pid=7749): Launched 16:51:06.361196 run osmo-stp_10.42.42.5(pid=7746): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7746)] 16:51:06.502970 run osmo-stp_10.42.42.5(pid=7746): stdout: | (launched: 2022-12-13_16:51:04.990447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:06.647323 run osmo-stp_10.42.42.5(pid=7746): stderr: | [0;m[38;5;43m20221213165105183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165105183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165105183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165105184 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165105184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165105184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165105184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:06.791611 run osmo-stp_10.42.42.5(pid=7746): stdout: | (launched: 2022-12-13_16:51:04.990447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:06.929625 run osmo-stp_10.42.42.5(pid=7746): stderr: | [0;m[38;5;43m20221213165105183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165105183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165105183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165105184 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165105184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165105184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165105184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:07.092560 run patchelf(pid=7749): Terminating (SIGINT) 16:51:07.281817 run patchelf(pid=7749): Terminated: ok {rc=0} 16:51:07.418449 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7746): Process ended prematurely: osmo-stp_10.42.42.5(pid=7746) [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7746)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 16:51:07.428867 tst iperf3.py:8: Test FAILED (8.0 sec) 16:51:07.457824 run osmo-hlr_10.42.42.2(pid=7743): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7743)] 16:51:07.508789 run osmo-hlr_10.42.42.2(pid=7743): stdout: | (launched: 2022-12-13_16:51:03.945966) 16:51:07.561615 run osmo-hlr_10.42.42.2(pid=7743): stderr: | [0;m[1;31m20221213165104146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165104146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165104147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165104147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165104147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165104147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165104183 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165104191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165104192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165104192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:07.614470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7738): Terminating (SIGTERM) 16:51:07.657123 run iperf3-srv_10.42.42.10(pid=7739): Terminating (SIGTERM) 16:51:07.699776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7742): Terminating (SIGTERM) 16:51:07.742461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7745): Terminating (SIGTERM) 16:51:07.785028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7748): Terminating (SIGTERM) 16:51:07.829583 --- ParallelTerminationStrategy: PID 7738 died... 16:51:07.849865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7738): Terminated: ok {rc=0} 16:51:07.896900 --- ParallelTerminationStrategy: PID 7739 died... 16:51:07.916926 run iperf3-srv_10.42.42.10(pid=7739): Terminated {rc=256} 16:51:07.963500 --- ParallelTerminationStrategy: PID 7742 died... 16:51:07.983518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7742): Terminated: ok {rc=0} 16:51:08.030073 --- ParallelTerminationStrategy: PID 7745 died... 16:51:08.050367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7745): Terminated: ok {rc=0} 16:51:08.097297 --- ParallelTerminationStrategy: PID 7748 died... 16:51:08.117334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7748): Terminated: ok {rc=0} 16:51:08.207384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:51:09.357726 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:09.369685 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:51:09.443192 tst iperf3m4.py: using LAC 34957 16:51:09.566632 tst iperf3m4.py: using RAC 22 16:51:09.690355 tst iperf3m4.py: using CellId 34957 16:51:09.813930 tst iperf3m4.py: using BVCI 34958 16:51:09.928339 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:09.939473 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:09.950521 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:09.961566 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:09.972878 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:09.984354 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:09.995887 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:10.007296 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:10.018912 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:51:10.139490 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:51:10.263433 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:51:10.383794 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:51:10.502686 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:51:10.714086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:51:11.031500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7751): Launched 16:51:11.308519 run iperf3-srv_10.42.42.10(pid=7752): Launched 16:51:11.427221 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:51:11.638692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:51:11.955744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7753): Launched 16:51:12.231752 run iperf3-srv_10.42.42.10(pid=7754): Launched 16:51:12.350917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:51:12.560897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:51:12.878787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7755): Launched 16:51:13.153906 run iperf3-srv_10.42.42.10(pid=7756): Launched 16:51:13.272468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:51:13.483428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:51:13.800598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7757): Launched 16:51:14.075622 run iperf3-srv_10.42.42.10(pid=7758): Launched 16:51:14.193348 tst iperf3m4.py:8: start network... 16:51:14.402366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:14.888131 run create_hlr_db(pid=7759): Launched 16:51:15.016855 bus /gobi_6: Setting Powered False 16:51:16.084399 run create_hlr_db(pid=7759): Terminated: ok {rc=0} 16:51:16.579681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7761): Launched 16:51:16.961552 run osmo-hlr_10.42.42.2(pid=7762): Launched 16:51:17.091152 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:17.711682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7764): Launched 16:51:18.049698 run osmo-stp_10.42.42.5(pid=7765): Launched 16:51:18.179908 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:51:18.757509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7767): Launched 16:51:18.882555 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:51:19.148915 run patchelf(pid=7768): Launched 16:51:19.323265 run osmo-stp_10.42.42.5(pid=7765): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7765)] 16:51:19.455642 run osmo-stp_10.42.42.5(pid=7765): stdout: | (launched: 2022-12-13_16:51:17.986985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:19.590497 run osmo-stp_10.42.42.5(pid=7765): stderr: | [0;m[38;5;43m20221213165118179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165118179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165118179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165118180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165118180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165118180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165118180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:19.724467 run osmo-stp_10.42.42.5(pid=7765): stdout: | (launched: 2022-12-13_16:51:17.986985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:19.852228 run osmo-stp_10.42.42.5(pid=7765): stderr: | [0;m[38;5;43m20221213165118179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165118179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165118179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165118180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165118180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165118180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165118180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:20.003375 run patchelf(pid=7768): Terminating (SIGINT) 16:51:20.180102 run patchelf(pid=7768): Terminated: ok {rc=0} 16:51:20.307636 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7765): Process ended prematurely: osmo-stp_10.42.42.5(pid=7765) [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7765)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:51:20.317367 tst iperf3m4.py:8: Test FAILED (11.0 sec) 16:51:20.344899 run osmo-hlr_10.42.42.2(pid=7762): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7762)] 16:51:20.392615 run osmo-hlr_10.42.42.2(pid=7762): stdout: | (launched: 2022-12-13_16:51:16.897528) 16:51:20.441963 run osmo-hlr_10.42.42.2(pid=7762): stderr: | [0;m[1;31m20221213165117257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165117257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165117257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165117257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165117257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165117257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165117270 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165117278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165117278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165117278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:20.491785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7751): Terminating (SIGTERM) 16:51:20.531795 run iperf3-srv_10.42.42.10(pid=7752): Terminating (SIGTERM) 16:51:20.571538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7753): Terminating (SIGTERM) 16:51:20.611399 run iperf3-srv_10.42.42.10(pid=7754): Terminating (SIGTERM) 16:51:20.651180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7755): Terminating (SIGTERM) 16:51:20.690954 run iperf3-srv_10.42.42.10(pid=7756): Terminating (SIGTERM) 16:51:20.730682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7757): Terminating (SIGTERM) 16:51:20.770485 run iperf3-srv_10.42.42.10(pid=7758): Terminating (SIGTERM) 16:51:20.810106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7761): Terminating (SIGTERM) 16:51:20.849922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7764): Terminating (SIGTERM) 16:51:20.889777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7767): Terminating (SIGTERM) 16:51:20.929931 --- ParallelTerminationStrategy: PID 7751 died... 16:51:20.949338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7751): Terminated: ok {rc=0} 16:51:20.993676 --- ParallelTerminationStrategy: PID 7752 died... 16:51:21.012290 run iperf3-srv_10.42.42.10(pid=7752): Terminated {rc=256} 16:51:21.057157 --- ParallelTerminationStrategy: PID 7753 died... 16:51:21.075924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7753): Terminated: ok {rc=0} 16:51:21.120066 --- ParallelTerminationStrategy: PID 7754 died... 16:51:21.138950 run iperf3-srv_10.42.42.10(pid=7754): Terminated {rc=256} 16:51:21.183000 --- ParallelTerminationStrategy: PID 7755 died... 16:51:21.201865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7755): Terminated: ok {rc=0} 16:51:21.246139 --- ParallelTerminationStrategy: PID 7756 died... 16:51:21.265063 run iperf3-srv_10.42.42.10(pid=7756): Terminated {rc=256} 16:51:21.309246 --- ParallelTerminationStrategy: PID 7757 died... 16:51:21.328106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7757): Terminated: ok {rc=0} 16:51:21.372591 --- ParallelTerminationStrategy: PID 7758 died... 16:51:21.391540 run iperf3-srv_10.42.42.10(pid=7758): Terminated {rc=256} 16:51:21.435786 --- ParallelTerminationStrategy: PID 7761 died... 16:51:21.455221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7761): Terminated: ok {rc=0} 16:51:21.499573 --- ParallelTerminationStrategy: PID 7764 died... 16:51:21.518832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7764): Terminated: ok {rc=0} 16:51:21.563386 --- ParallelTerminationStrategy: PID 7767 died... 16:51:21.582463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7767): Terminated: ok {rc=0} 16:51:21.668799 bus /gobi_4: Setting Powered False 16:51:22.769395 bus /gobi_4: Setting Powered False 16:51:23.887586 bus /gobi_1: Setting Powered False 16:51:24.986038 bus /gobi_1: Setting Powered False 16:51:26.102513 bus /gobi_0: Setting Powered False 16:51:27.201787 bus /gobi_0: Setting Powered False 16:51:28.318717 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:51:29.422665 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:29.434702 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:51:29.503565 tst ping.py: using LAC 34958 16:51:29.624656 tst ping.py: using RAC 23 16:51:29.754439 tst ping.py: using CellId 34958 16:51:29.883614 tst ping.py: using BVCI 34959 16:51:30.003487 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:30.015427 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:30.027326 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:30.038902 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:30.050822 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:30.062781 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:30.074830 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:30.086558 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:51:30.203298 tst ping.py:19: start network... 16:51:30.410355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:30.933761 run create_hlr_db(pid=7769): Launched 16:51:31.103742 bus /gobi_6: Setting Powered False 16:51:32.173713 run create_hlr_db(pid=7769): Terminated: ok {rc=0} 16:51:32.607789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7771): Launched 16:51:32.919089 run osmo-hlr_10.42.42.2(pid=7772): Launched 16:51:33.036189 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:33.574843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7774): Launched 16:51:33.885636 run osmo-stp_10.42.42.5(pid=7775): Launched 16:51:34.002533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:51:34.533069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7777): Launched 16:51:34.650948 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:51:34.912097 run patchelf(pid=7778): Launched 16:51:35.083424 run osmo-stp_10.42.42.5(pid=7775): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7775)] 16:51:35.213395 run osmo-stp_10.42.42.5(pid=7775): stdout: | (launched: 2022-12-13_16:51:33.827460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:35.345434 run osmo-stp_10.42.42.5(pid=7775): stderr: | [0;m[38;5;43m20221213165133999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165133999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165134000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165134000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165134000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165134001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165134001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:35.477491 run osmo-stp_10.42.42.5(pid=7775): stdout: | (launched: 2022-12-13_16:51:33.827460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:35.603114 run osmo-stp_10.42.42.5(pid=7775): stderr: | [0;m[38;5;43m20221213165133999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165133999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165134000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165134000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165134000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165134001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165134001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:35.752775 run patchelf(pid=7778): Terminating (SIGINT) 16:51:35.925842 run patchelf(pid=7778): Terminated: ok {rc=0} 16:51:36.050235 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7775): Process ended prematurely: osmo-stp_10.42.42.5(pid=7775) [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7775)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 16:51:36.059241 tst ping.py:22: Test FAILED (6.6 sec) 16:51:36.086475 run osmo-hlr_10.42.42.2(pid=7772): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7772)] 16:51:36.134183 run osmo-hlr_10.42.42.2(pid=7772): stdout: | (launched: 2022-12-13_16:51:32.860527) 16:51:36.183505 run osmo-hlr_10.42.42.2(pid=7772): stderr: | [0;m[1;31m20221213165133038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165133038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165133038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165133038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165133038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165133038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165133050 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165133058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165133058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165133058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:36.233535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7771): Terminating (SIGTERM) 16:51:36.273228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7774): Terminating (SIGTERM) 16:51:36.312929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7777): Terminating (SIGTERM) 16:51:36.352938 --- ParallelTerminationStrategy: PID 7771 died... 16:51:36.372232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7771): Terminated: ok {rc=0} 16:51:36.416264 --- ParallelTerminationStrategy: PID 7774 died... 16:51:36.434978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7774): Terminated: ok {rc=0} 16:51:36.479301 --- ParallelTerminationStrategy: PID 7777 died... 16:51:36.498194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7777): Terminated: ok {rc=0} 16:51:36.582182 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:51:37.670445 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:37.683197 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:51:37.755304 tst ping_idle_ping.py: using LAC 34959 16:51:37.887074 tst ping_idle_ping.py: using RAC 24 16:51:38.017431 tst ping_idle_ping.py: using CellId 34959 16:51:38.141024 tst ping_idle_ping.py: using BVCI 34960 16:51:38.254696 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:38.265959 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:38.277128 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:38.288250 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:38.299146 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:38.310117 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:38.321114 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:51:38.331991 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:51:38.449599 tst ping_idle_ping.py:24: start network... 16:51:38.657384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:39.139748 run create_hlr_db(pid=7779): Launched 16:51:39.266434 bus /gobi_6: Setting Powered False 16:51:40.328577 run create_hlr_db(pid=7779): Terminated: ok {rc=0} 16:51:40.782133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7781): Launched 16:51:41.115456 run osmo-hlr_10.42.42.2(pid=7782): Launched 16:51:41.243078 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:41.813042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7784): Launched 16:51:42.145736 run osmo-stp_10.42.42.5(pid=7785): Launched 16:51:42.272410 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:51:42.842600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7787): Launched 16:51:42.969745 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:51:43.249685 run patchelf(pid=7788): Launched 16:51:43.433543 run osmo-stp_10.42.42.5(pid=7785): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7785)] 16:51:43.573338 run osmo-stp_10.42.42.5(pid=7785): stdout: | (launched: 2022-12-13_16:51:42.083967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:43.715733 run osmo-stp_10.42.42.5(pid=7785): stderr: | [0;m[38;5;43m20221213165142279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165142279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165142279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165142280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165142280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165142280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165142280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:43.858329 run osmo-stp_10.42.42.5(pid=7785): stdout: | (launched: 2022-12-13_16:51:42.083967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:43.993736 run osmo-stp_10.42.42.5(pid=7785): stderr: | [0;m[38;5;43m20221213165142279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165142279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165142279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165142280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165142280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165142280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165142280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:44.154494 run patchelf(pid=7788): Terminating (SIGINT) 16:51:44.340290 run patchelf(pid=7788): Terminated: ok {rc=0} 16:51:44.473972 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7785): Process ended prematurely: osmo-stp_10.42.42.5(pid=7785) [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7785)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:51:44.483737 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:51:44.512330 run osmo-hlr_10.42.42.2(pid=7782): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7782)] 16:51:44.563197 run osmo-hlr_10.42.42.2(pid=7782): stdout: | (launched: 2022-12-13_16:51:41.053972) 16:51:44.615798 run osmo-hlr_10.42.42.2(pid=7782): stderr: | [0;m[1;31m20221213165141254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165141254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165141254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165141254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165141254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165141254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165141266 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165141275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165141275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165141275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:44.669322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7781): Terminating (SIGTERM) 16:51:44.711432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7784): Terminating (SIGTERM) 16:51:44.754093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7787): Terminating (SIGTERM) 16:51:44.796815 --- ParallelTerminationStrategy: PID 7781 died... 16:51:44.817485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7781): Terminated: ok {rc=0} 16:51:44.864556 --- ParallelTerminationStrategy: PID 7784 died... 16:51:44.884573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7784): Terminated: ok {rc=0} 16:51:44.931497 --- ParallelTerminationStrategy: PID 7787 died... 16:51:44.951431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7787): Terminated: ok {rc=0} 16:51:45.040929 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:51:46.380891 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:51:46.394287 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:51:46.433375 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 16:51:46.482838 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 16:51:46.587465 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:51:46.622562 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 16:51:46.665579 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 16:51:47.280243 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 16:51:47.331808 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:47.343302 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:51:47.393138 tst cs_paging_gprs_active.py: using LAC 34960 16:51:47.522761 tst cs_paging_gprs_active.py: using RAC 25 16:51:47.652688 tst cs_paging_gprs_active.py: using CellId 34960 16:51:47.781401 tst cs_paging_gprs_active.py: using BVCI 34961 16:51:47.901707 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:47.913862 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:47.925795 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:47.937851 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:47.950136 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:47.962368 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:47.974701 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:47.986940 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:47.999397 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:51:48.119154 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:51:48.240884 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:51:48.464598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:51:48.796822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7792): Launched 16:51:49.086508 run iperf3-srv_10.42.42.10(pid=7793): Launched 16:51:49.210815 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:51:49.433177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:51:49.765783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7794): Launched 16:51:50.054273 run iperf3-srv_10.42.42.10(pid=7795): Launched 16:51:50.178572 tst cs_paging_gprs_active.py:38: start network... 16:51:50.401267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:50.913888 run create_hlr_db(pid=7796): Launched 16:51:51.039955 bus /gobi_6: Setting Powered False 16:51:52.105119 run create_hlr_db(pid=7796): Terminated: ok {rc=0} 16:51:52.548312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7798): Launched 16:51:52.860350 run osmo-hlr_10.42.42.2(pid=7799): Launched 16:51:52.979160 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:53.525390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7801): Launched 16:51:53.836775 run osmo-stp_10.42.42.5(pid=7802): Launched 16:51:53.955206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:51:54.489834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7804): Launched 16:51:54.609307 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:51:54.872555 run patchelf(pid=7805): Launched 16:51:55.045188 run osmo-stp_10.42.42.5(pid=7802): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7802)] 16:51:55.176544 run osmo-stp_10.42.42.5(pid=7802): stdout: | (launched: 2022-12-13_16:51:53.778866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:55.309660 run osmo-stp_10.42.42.5(pid=7802): stderr: | [0;m[38;5;43m20221213165153950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165153950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165153950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165153950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165153951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165153951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165153951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:55.442562 run osmo-stp_10.42.42.5(pid=7802): stdout: | (launched: 2022-12-13_16:51:53.778866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:55.569294 run osmo-stp_10.42.42.5(pid=7802): stderr: | [0;m[38;5;43m20221213165153950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165153950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165153950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165153950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165153951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165153951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165153951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:55.719301 run patchelf(pid=7805): Terminating (SIGINT) 16:51:55.894975 run patchelf(pid=7805): Terminated: ok {rc=0} 16:51:56.021150 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7802): Process ended prematurely: osmo-stp_10.42.42.5(pid=7802) [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7802)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 16:51:56.031308 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:51:56.058726 run osmo-hlr_10.42.42.2(pid=7799): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7799)] 16:51:56.106819 run osmo-hlr_10.42.42.2(pid=7799): stdout: | (launched: 2022-12-13_16:51:52.802252) 16:51:56.157264 run osmo-hlr_10.42.42.2(pid=7799): stderr: | [0;m[1;31m20221213165152980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165152980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165152980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165152980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165152980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165152980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165152992 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165153000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165153001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165153001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:56.207127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7792): Terminating (SIGTERM) 16:51:56.247072 run iperf3-srv_10.42.42.10(pid=7793): Terminating (SIGTERM) 16:51:56.286823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7794): Terminating (SIGTERM) 16:51:56.326752 run iperf3-srv_10.42.42.10(pid=7795): Terminating (SIGTERM) 16:51:56.366564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7798): Terminating (SIGTERM) 16:51:56.406489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7801): Terminating (SIGTERM) 16:51:56.446421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7804): Terminating (SIGTERM) 16:51:56.486533 --- ParallelTerminationStrategy: PID 7792 died... 16:51:56.505308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7792): Terminated: ok {rc=0} 16:51:56.549359 --- ParallelTerminationStrategy: PID 7793 died... 16:51:56.567994 run iperf3-srv_10.42.42.10(pid=7793): Terminated {rc=256} 16:51:56.611880 --- ParallelTerminationStrategy: PID 7794 died... 16:51:56.630525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7794): Terminated: ok {rc=0} 16:51:56.674499 --- ParallelTerminationStrategy: PID 7795 died... 16:51:56.693140 run iperf3-srv_10.42.42.10(pid=7795): Terminated {rc=256} 16:51:56.737039 --- ParallelTerminationStrategy: PID 7798 died... 16:51:56.755783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7798): Terminated: ok {rc=0} 16:51:56.799687 --- ParallelTerminationStrategy: PID 7801 died... 16:51:56.818542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7801): Terminated: ok {rc=0} 16:51:56.862558 --- ParallelTerminationStrategy: PID 7804 died... 16:51:56.881185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7804): Terminated: ok {rc=0} 16:51:56.966878 bus /gobi_0: Setting Powered False 16:51:58.067301 bus /gobi_0: Setting Powered False 16:51:59.181981 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 16:52:00.335028 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:00.347831 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:52:00.400674 tst iperf3.py: using LAC 34961 16:52:00.531346 tst iperf3.py: using RAC 26 16:52:00.653190 tst iperf3.py: using CellId 34961 16:52:00.775448 tst iperf3.py: using BVCI 34962 16:52:00.894007 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:00.906117 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:00.918562 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:00.931169 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:00.943582 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:00.955620 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:00.967653 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:00.979534 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:00.992216 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:52:01.126699 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:52:01.355814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:52:01.699946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7806): Launched 16:52:02.009296 run iperf3-srv_10.42.42.10(pid=7807): Launched 16:52:02.151835 tst iperf3.py:8: start network... 16:52:02.375744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:52:02.887652 run create_hlr_db(pid=7808): Launched 16:52:03.014298 bus /gobi_6: Setting Powered False 16:52:04.075760 run create_hlr_db(pid=7808): Terminated: ok {rc=0} 16:52:04.534487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7810): Launched 16:52:04.865606 run osmo-hlr_10.42.42.2(pid=7811): Launched 16:52:04.992556 run osmo-stp_10.42.42.5: Starting osmo-stp 16:52:05.557686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7813): Launched 16:52:05.888025 run osmo-stp_10.42.42.5(pid=7814): Launched 16:52:06.015160 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:52:06.585384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7816): Launched 16:52:06.712194 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:52:06.992447 run patchelf(pid=7817): Launched 16:52:07.176740 run osmo-stp_10.42.42.5(pid=7814): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7814)] 16:52:07.316142 run osmo-stp_10.42.42.5(pid=7814): stdout: | (launched: 2022-12-13_16:52:05.826429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:07.457649 run osmo-stp_10.42.42.5(pid=7814): stderr: | [0;m[38;5;43m20221213165206020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165206020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165206020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165206021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165206021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165206021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165206021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:07.599685 run osmo-stp_10.42.42.5(pid=7814): stdout: | (launched: 2022-12-13_16:52:05.826429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:07.734728 run osmo-stp_10.42.42.5(pid=7814): stderr: | [0;m[38;5;43m20221213165206020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165206020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165206020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165206021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165206021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165206021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165206021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:07.895590 run patchelf(pid=7817): Terminating (SIGINT) 16:52:08.081187 run patchelf(pid=7817): Terminated: ok {rc=0} 16:52:08.214912 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7814): Process ended prematurely: osmo-stp_10.42.42.5(pid=7814) [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7814)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 16:52:08.225375 tst iperf3.py:8: Test FAILED (7.9 sec) 16:52:08.254304 run osmo-hlr_10.42.42.2(pid=7811): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7811)] 16:52:08.305489 run osmo-hlr_10.42.42.2(pid=7811): stdout: | (launched: 2022-12-13_16:52:04.804177) 16:52:08.358475 run osmo-hlr_10.42.42.2(pid=7811): stderr: | [0;m[1;31m20221213165205003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165205003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165205003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165205003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165205003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165205003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165205014 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165205024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165205024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165205024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:52:08.411781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7806): Terminating (SIGTERM) 16:52:08.454179 run iperf3-srv_10.42.42.10(pid=7807): Terminating (SIGTERM) 16:52:08.496736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7810): Terminating (SIGTERM) 16:52:08.539474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7813): Terminating (SIGTERM) 16:52:08.582154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7816): Terminating (SIGTERM) 16:52:08.624891 --- ParallelTerminationStrategy: PID 7806 died... 16:52:08.645540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7806): Terminated: ok {rc=0} 16:52:08.692337 --- ParallelTerminationStrategy: PID 7807 died... 16:52:08.712341 run iperf3-srv_10.42.42.10(pid=7807): Terminated {rc=256} 16:52:08.758645 --- ParallelTerminationStrategy: PID 7810 died... 16:52:08.778664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7810): Terminated: ok {rc=0} 16:52:08.825339 --- ParallelTerminationStrategy: PID 7813 died... 16:52:08.845438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7813): Terminated: ok {rc=0} 16:52:08.892358 --- ParallelTerminationStrategy: PID 7816 died... 16:52:08.912376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7816): Terminated: ok {rc=0} 16:52:09.001767 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 16:52:10.152142 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:10.164924 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:52:10.219934 tst iperf3m4.py: using LAC 34962 16:52:10.348656 tst iperf3m4.py: using RAC 27 16:52:10.476377 tst iperf3m4.py: using CellId 34962 16:52:10.605449 tst iperf3m4.py: using BVCI 34963 16:52:10.719097 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:10.730746 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:10.742433 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:10.753992 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:10.766126 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:10.778206 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:10.790578 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:10.802763 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:10.815125 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:52:10.940098 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:52:11.063770 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:52:11.186687 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:52:11.306676 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:52:11.517220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:52:11.830577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7818): Launched 16:52:12.103555 run iperf3-srv_10.42.42.10(pid=7819): Launched 16:52:12.220036 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:52:12.427542 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:52:12.739906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7820): Launched 16:52:13.011250 run iperf3-srv_10.42.42.10(pid=7821): Launched 16:52:13.127786 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:52:13.334745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:52:13.646451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7822): Launched 16:52:13.917505 run iperf3-srv_10.42.42.10(pid=7823): Launched 16:52:14.034479 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:52:14.240814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:52:14.552569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7824): Launched 16:52:14.823961 run iperf3-srv_10.42.42.10(pid=7825): Launched 16:52:14.940513 tst iperf3m4.py:8: start network... 16:52:15.147265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:52:15.628366 run create_hlr_db(pid=7826): Launched 16:52:15.755522 bus /gobi_6: Setting Powered False 16:52:16.817443 run create_hlr_db(pid=7826): Terminated: ok {rc=0} 16:52:17.289842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7828): Launched 16:52:17.610550 run osmo-hlr_10.42.42.2(pid=7829): Launched 16:52:17.729342 run osmo-stp_10.42.42.5: Starting osmo-stp 16:52:18.263689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7831): Launched 16:52:18.576289 run osmo-stp_10.42.42.5(pid=7832): Launched 16:52:18.694471 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:52:19.231209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7834): Launched 16:52:19.350426 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:52:19.613619 run patchelf(pid=7835): Launched 16:52:19.786208 run osmo-stp_10.42.42.5(pid=7832): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7832)] 16:52:19.917389 run osmo-stp_10.42.42.5(pid=7832): stdout: | (launched: 2022-12-13_16:52:18.518119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:20.051551 run osmo-stp_10.42.42.5(pid=7832): stderr: | [0;m[38;5;43m20221213165218690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165218690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165218690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165218691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165218691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165218691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165218691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:20.184695 run osmo-stp_10.42.42.5(pid=7832): stdout: | (launched: 2022-12-13_16:52:18.518119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:20.311652 run osmo-stp_10.42.42.5(pid=7832): stderr: | [0;m[38;5;43m20221213165218690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165218690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165218690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165218691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165218691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165218691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165218691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:20.462750 run patchelf(pid=7835): Terminating (SIGINT) 16:52:20.637174 run patchelf(pid=7835): Terminated: ok {rc=0} 16:52:20.762904 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7832): Process ended prematurely: osmo-stp_10.42.42.5(pid=7832) [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7832)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 16:52:20.772579 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:52:20.800121 run osmo-hlr_10.42.42.2(pid=7829): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7829)] 16:52:20.847829 run osmo-hlr_10.42.42.2(pid=7829): stdout: | (launched: 2022-12-13_16:52:17.552636) 16:52:20.897577 run osmo-hlr_10.42.42.2(pid=7829): stderr: | [0;m[1;31m20221213165217730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165217730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165217731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165217731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165217731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165217731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165217742 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165217751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165217751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165217751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:52:20.947619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7818): Terminating (SIGTERM) 16:52:20.987338 run iperf3-srv_10.42.42.10(pid=7819): Terminating (SIGTERM) 16:52:21.027036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7820): Terminating (SIGTERM) 16:52:21.066856 run iperf3-srv_10.42.42.10(pid=7821): Terminating (SIGTERM) 16:52:21.106507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7822): Terminating (SIGTERM) 16:52:21.146039 run iperf3-srv_10.42.42.10(pid=7823): Terminating (SIGTERM) 16:52:21.185555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7824): Terminating (SIGTERM) 16:52:21.225135 run iperf3-srv_10.42.42.10(pid=7825): Terminating (SIGTERM) 16:52:21.264570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7828): Terminating (SIGTERM) 16:52:21.304365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7831): Terminating (SIGTERM) 16:52:21.344018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7834): Terminating (SIGTERM) 16:52:21.383974 --- ParallelTerminationStrategy: PID 7818 died... 16:52:21.403290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7818): Terminated: ok {rc=0} 16:52:21.447153 --- ParallelTerminationStrategy: PID 7819 died... 16:52:21.465797 run iperf3-srv_10.42.42.10(pid=7819): Terminated {rc=256} 16:52:21.509613 --- ParallelTerminationStrategy: PID 7820 died... 16:52:21.528222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7820): Terminated: ok {rc=0} 16:52:21.571882 --- ParallelTerminationStrategy: PID 7821 died... 16:52:21.590580 run iperf3-srv_10.42.42.10(pid=7821): Terminated {rc=256} 16:52:21.634198 --- ParallelTerminationStrategy: PID 7822 died... 16:52:21.652709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7822): Terminated: ok {rc=0} 16:52:21.696563 --- ParallelTerminationStrategy: PID 7823 died... 16:52:21.715308 run iperf3-srv_10.42.42.10(pid=7823): Terminated {rc=256} 16:52:21.759072 --- ParallelTerminationStrategy: PID 7824 died... 16:52:21.777684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7824): Terminated: ok {rc=0} 16:52:21.821659 --- ParallelTerminationStrategy: PID 7825 died... 16:52:21.840268 run iperf3-srv_10.42.42.10(pid=7825): Terminated {rc=256} 16:52:21.884116 --- ParallelTerminationStrategy: PID 7828 died... 16:52:21.902915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7828): Terminated: ok {rc=0} 16:52:21.947308 --- ParallelTerminationStrategy: PID 7831 died... 16:52:21.966282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7831): Terminated: ok {rc=0} 16:52:22.010617 --- ParallelTerminationStrategy: PID 7834 died... 16:52:22.029602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7834): Terminated: ok {rc=0} 16:52:22.115896 bus /gobi_4: Setting Powered False 16:52:23.216325 bus /gobi_4: Setting Powered False 16:52:24.333413 bus /gobi_1: Setting Powered False 16:52:25.434824 bus /gobi_1: Setting Powered False 16:52:26.552754 bus /gobi_0: Setting Powered False 16:52:27.650815 bus /gobi_0: Setting Powered False 16:52:28.768689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 16:52:29.871421 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:29.884319 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:52:29.938007 tst ping.py: using LAC 34963 16:52:30.058423 tst ping.py: using RAC 28 16:52:30.179408 tst ping.py: using CellId 34963 16:52:30.298766 tst ping.py: using BVCI 34964 16:52:30.410675 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:30.422441 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:30.433994 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:30.445381 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:30.456545 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:30.467887 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:30.479354 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:30.490662 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:52:30.612132 tst ping.py:19: start network... 16:52:30.838681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:52:31.354353 run create_hlr_db(pid=7836): Launched 16:52:31.522591 bus /gobi_6: Setting Powered False 16:52:32.586448 run create_hlr_db(pid=7836): Terminated: ok {rc=0} 16:52:33.027293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7838): Launched 16:52:33.354783 run osmo-hlr_10.42.42.2(pid=7839): Launched 16:52:33.479121 run osmo-stp_10.42.42.5: Starting osmo-stp 16:52:34.045469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7841): Launched 16:52:34.372927 run osmo-stp_10.42.42.5(pid=7842): Launched 16:52:34.497495 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:52:35.073235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7844): Launched 16:52:35.194704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:52:35.462436 run patchelf(pid=7845): Launched 16:52:35.639057 run osmo-stp_10.42.42.5(pid=7842): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7842)] 16:52:35.773783 run osmo-stp_10.42.42.5(pid=7842): stdout: | (launched: 2022-12-13_16:52:34.312637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:35.911141 run osmo-stp_10.42.42.5(pid=7842): stderr: | [0;m[38;5;43m20221213165234503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165234503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165234504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165234504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165234504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165234505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165234505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:36.048655 run osmo-stp_10.42.42.5(pid=7842): stdout: | (launched: 2022-12-13_16:52:34.312637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:36.179317 run osmo-stp_10.42.42.5(pid=7842): stderr: | [0;m[38;5;43m20221213165234503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165234503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165234504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165234504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165234504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165234505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165234505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:36.334220 run patchelf(pid=7845): Terminating (SIGINT) 16:52:36.512728 run patchelf(pid=7845): Terminated: ok {rc=0} 16:52:36.642040 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7842): Process ended prematurely: osmo-stp_10.42.42.5(pid=7842) [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7842)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 16:52:36.651596 tst ping.py:22: Test FAILED (6.8 sec) 16:52:36.679749 run osmo-hlr_10.42.42.2(pid=7839): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7839)] 16:52:36.730742 run osmo-hlr_10.42.42.2(pid=7839): stdout: | (launched: 2022-12-13_16:52:33.294084) 16:52:36.783219 run osmo-hlr_10.42.42.2(pid=7839): stderr: | [0;m[1;31m20221213165233492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165233492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165233492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165233492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165233492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165233493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165233505 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165233514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165233514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165233514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:52:36.836476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7838): Terminating (SIGTERM) 16:52:36.878762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7841): Terminating (SIGTERM) 16:52:36.922589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7844): Terminating (SIGTERM) 16:52:36.965126 --- ParallelTerminationStrategy: PID 7838 died... 16:52:36.985669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7838): Terminated: ok {rc=0} 16:52:37.032114 --- ParallelTerminationStrategy: PID 7841 died... 16:52:37.052065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7841): Terminated: ok {rc=0} 16:52:37.098675 --- ParallelTerminationStrategy: PID 7844 died... 16:52:37.118482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7844): Terminated: ok {rc=0} 16:52:37.206171 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 16:52:38.293549 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:38.306126 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:52:38.359867 tst ping_idle_ping.py: using LAC 34964 16:52:38.485152 tst ping_idle_ping.py: using RAC 29 16:52:38.608787 tst ping_idle_ping.py: using CellId 34964 16:52:38.735964 tst ping_idle_ping.py: using BVCI 34965 16:52:38.851101 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:38.863316 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:38.875449 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:38.887460 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:38.899606 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:38.911838 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:38.924337 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:52:38.936366 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:52:39.053052 tst ping_idle_ping.py:24: start network... 16:52:39.251462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:52:39.716153 run create_hlr_db(pid=7848): Launched 16:52:39.838910 bus /gobi_6: Setting Powered False 16:52:40.898280 run create_hlr_db(pid=7848): Terminated: ok {rc=0} 16:52:41.313958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7850): Launched 16:52:41.612266 run osmo-hlr_10.42.42.2(pid=7851): Launched 16:52:41.724741 run osmo-stp_10.42.42.5: Starting osmo-stp 16:52:42.236057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7853): Launched 16:52:42.534081 run osmo-stp_10.42.42.5(pid=7854): Launched 16:52:42.646645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:52:43.158789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7856): Launched 16:52:43.272601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:52:43.524902 run patchelf(pid=7857): Launched 16:52:43.690415 run osmo-stp_10.42.42.5(pid=7854): ERR: Terminated: ERROR {rc=1} [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7854)] 16:52:43.816393 run osmo-stp_10.42.42.5(pid=7854): stdout: | (launched: 2022-12-13_16:52:42.479091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:43.944216 run osmo-stp_10.42.42.5(pid=7854): stderr: | [0;m[38;5;43m20221213165242646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165242646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165242646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165242646 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165242647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165242647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165242647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:44.071840 run osmo-stp_10.42.42.5(pid=7854): stdout: | (launched: 2022-12-13_16:52:42.479091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:44.193743 run osmo-stp_10.42.42.5(pid=7854): stderr: | [0;m[38;5;43m20221213165242646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165242646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165242646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165242646 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165242647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165242647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165242647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:44.337976 run patchelf(pid=7857): Terminating (SIGINT) 16:52:44.504242 run patchelf(pid=7857): Terminated: ok {rc=0} 16:52:44.624201 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7854): Process ended prematurely: osmo-stp_10.42.42.5(pid=7854) [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7854)] [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 16:52:44.633144 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 16:52:44.659773 run osmo-hlr_10.42.42.2(pid=7851): ERR: Terminated: ERROR {rc=237} [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7851)] 16:52:44.707226 run osmo-hlr_10.42.42.2(pid=7851): stdout: | (launched: 2022-12-13_16:52:41.556900) 16:52:44.756538 run osmo-hlr_10.42.42.2(pid=7851): stderr: | [0;m[1;31m20221213165241731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165241731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165241732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165241732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165241732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165241732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165241744 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165241752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165241753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165241753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:52:44.805896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7850): Terminating (SIGTERM) 16:52:44.845324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7853): Terminating (SIGTERM) 16:52:44.884656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7856): Terminating (SIGTERM) 16:52:44.924200 --- ParallelTerminationStrategy: PID 7850 died... 16:52:44.942709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7850): Terminated: ok {rc=0} 16:52:44.987249 --- ParallelTerminationStrategy: PID 7853 died... 16:52:45.005608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7853): Terminated: ok {rc=0} 16:52:45.048598 --- ParallelTerminationStrategy: PID 7856 died... 16:52:45.067071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7856): Terminated: ok {rc=0} 16:52:45.151541 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 16:52:46.513124 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:52:46.522225 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:52:46.558579 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:52:46.597151 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:52:46.653836 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:52:46.688512 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:52:46.726620 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:52:47.283864 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2391 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:52:47.289279 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:52:47.300854 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:52:47.368848 tst switch_tch_pdch.py: using LAC 34965 16:52:47.487396 tst switch_tch_pdch.py: using RAC 30 16:52:47.604902 tst switch_tch_pdch.py: using CellId 34965 16:52:47.720763 tst switch_tch_pdch.py: using BVCI 34966 16:52:47.827475 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:52:47.839003 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:52:47.850323 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:52:47.861661 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:52:47.873010 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:52:47.884339 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:52:47.895784 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:52:47.907162 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:52:48.021581 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:52:48.141854 tst switch_tch_pdch.py:51: start network... 16:52:48.355290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:52:48.845902 run create_hlr_db(pid=7861): Launched 16:52:48.967944 bus /gobi_6: Setting Powered False 16:52:50.031536 run create_hlr_db(pid=7861): Terminated: ok {rc=0} 16:52:50.457429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7863): Launched 16:52:50.753652 run osmo-hlr_10.42.42.2(pid=7864): Launched 16:52:50.866397 run osmo-stp_10.42.42.5: Starting osmo-stp 16:52:51.375821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7866): Launched 16:52:51.673644 run osmo-stp_10.42.42.5(pid=7867): Launched 16:52:51.786744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:52:52.299527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7869): Launched 16:52:52.413250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:52:52.663702 run patchelf(pid=7870): Launched 16:52:52.828621 run osmo-stp_10.42.42.5(pid=7867): ERR: Terminated: ERROR {rc=1} [trial-2391↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7867)] 16:52:52.954079 run osmo-stp_10.42.42.5(pid=7867): stdout: | (launched: 2022-12-13_16:52:51.618702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:53.081573 run osmo-stp_10.42.42.5(pid=7867): stderr: | [0;m[38;5;43m20221213165251783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165251783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165251783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165251784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165251784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165251784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165251785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:53.208843 run osmo-stp_10.42.42.5(pid=7867): stdout: | (launched: 2022-12-13_16:52:51.618702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:53.329799 run osmo-stp_10.42.42.5(pid=7867): stderr: | [0;m[38;5;43m20221213165251783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165251783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165251783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165251784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165251784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165251784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165251785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:53.473829 run patchelf(pid=7870): Terminating (SIGINT) 16:52:53.640611 run patchelf(pid=7870): Terminated: ok {rc=0} 16:52:53.760381 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7867): Process ended prematurely: osmo-stp_10.42.42.5(pid=7867) [trial-2391↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7867)] [trial-2391↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:52:53.769238 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:52:53.795462 run osmo-hlr_10.42.42.2(pid=7864): ERR: Terminated: ERROR {rc=237} [trial-2391↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7864)] 16:52:53.842994 run osmo-hlr_10.42.42.2(pid=7864): stdout: | (launched: 2022-12-13_16:52:50.698938) 16:52:53.892120 run osmo-hlr_10.42.42.2(pid=7864): stderr: | [0;m[1;31m20221213165250871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165250871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165250871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165250871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165250871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165250871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165250883 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165250892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165250892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165250893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:52:53.941369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7863): Terminating (SIGTERM) 16:52:53.980847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7866): Terminating (SIGTERM) 16:52:54.020484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7869): Terminating (SIGTERM) 16:52:54.060007 --- ParallelTerminationStrategy: PID 7863 died... 16:52:54.079044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7863): Terminated: ok {rc=0} 16:52:54.122587 --- ParallelTerminationStrategy: PID 7866 died... 16:52:54.141037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7866): Terminated: ok {rc=0} 16:52:54.184299 --- ParallelTerminationStrategy: PID 7869 died... 16:52:54.202734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7869): Terminated: ok {rc=0} 16:52:54.288246 bus /gobi_0: Setting Powered False 16:52:55.387820 bus /gobi_0: Setting Powered False 16:52:56.500672 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2391 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 nitb_smpp --------------------------------------------------------------------- 16:52:57.758958 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:52:57.761768 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 16:52:57.782802 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 16:52:57.789788 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 16:52:57.824475 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 16:52:57.846664 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 16:52:57.853611 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 16:52:58.373734 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2391 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 16:52:58.379204 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:52:58.398293 tst esme_connect_policy_acceptall.py: using MSISDN 8228 16:52:58.541341 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:52:59.145817 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7875): Launched 16:52:59.470720 run osmo-nitb_10.42.42.2(pid=7876): Launched 16:52:59.650837 run osmo-nitb_10.42.42.2(pid=7876): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7876)] 16:52:59.795842 run osmo-nitb_10.42.42.2(pid=7876): stdout: | (launched: 2022-12-13_16:52:59.411628) 16:52:59.943134 run osmo-nitb_10.42.42.2(pid=7876): stderr: | (launched: 2022-12-13_16:52:59.459899) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:53:00.089844 run osmo-nitb_10.42.42.2(pid=7876): stdout: | (launched: 2022-12-13_16:52:59.411628) 16:53:00.230745 run osmo-nitb_10.42.42.2(pid=7876): stderr: | (launched: 2022-12-13_16:52:59.459899) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7876): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7876) [trial-2391↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7876)] 16:53:00.593733 tst osmo-nitb_10.42.42.2(pid=7876): stdout: | (launched: 2022-12-13_16:52:59.411628) 16:53:00.724483 tst osmo-nitb_10.42.42.2(pid=7876): stderr: | (launched: 2022-12-13_16:52:59.459899) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:53:00.884818 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=7876): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7876) [trial-2391↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7876)] [trial-2391↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 16:53:00.894317 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 16:53:00.907758 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7875): Terminating (SIGTERM) 16:53:01.121169 --- ParallelTerminationStrategy: PID 7875 died... 16:53:01.145457 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7875): Terminated: ok {rc=0} ---------------------------------------------- trial-2391 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 16:53:01.214386 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:53:01.241102 tst esme_connect_policy_closed.py: using MSISDN 8229 16:53:01.409170 tst esme_connect_policy_closed.py: using MSISDN 8230 16:53:01.531999 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:53:02.150956 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7877): Launched 16:53:02.488731 run osmo-nitb_10.42.42.2(pid=7878): Launched 16:53:02.663753 run osmo-nitb_10.42.42.2(pid=7878): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7878)] 16:53:02.796802 run osmo-nitb_10.42.42.2(pid=7878): stdout: | (launched: 2022-12-13_16:53:02.429379) 16:53:02.932023 run osmo-nitb_10.42.42.2(pid=7878): stderr: | (launched: 2022-12-13_16:53:02.477816) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:53:03.066800 run osmo-nitb_10.42.42.2(pid=7878): stdout: | (launched: 2022-12-13_16:53:02.429379) 16:53:03.195714 run osmo-nitb_10.42.42.2(pid=7878): stderr: | (launched: 2022-12-13_16:53:02.477816) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:53:03.349933 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=7878): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7878) [trial-2391↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7878)] [trial-2391↪nitb_smpp↪esme_connect_policy_closed.py:24] 16:53:03.358890 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 16:53:03.365961 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7877): Terminating (SIGTERM) 16:53:03.576715 --- ParallelTerminationStrategy: PID 7877 died... 16:53:03.598214 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7877): Terminated: ok {rc=0} ---------------------------------------------- trial-2391 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 16:53:03.649419 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:53:03.661523 tst nitb_smpp: Using 1 x bts (candidates: 1) 16:53:03.701166 tst esme_ms_sms_storeforward.py: using LAC 34966 16:53:03.822104 tst esme_ms_sms_storeforward.py: using RAC 31 16:53:03.945664 tst esme_ms_sms_storeforward.py: using CellId 34966 16:53:04.065489 tst esme_ms_sms_storeforward.py: using BVCI 34967 16:53:04.176164 tst nitb_smpp: Using 1 x modem (candidates: 1) 16:53:04.307561 tst esme_ms_sms_storeforward.py: using MSISDN 8231 16:53:04.427324 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 16:53:04.648582 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:53:05.312786 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7879): Launched 16:53:05.640655 run osmo-nitb_10.42.42.2(pid=7880): Launched 16:53:05.817358 run osmo-nitb_10.42.42.2(pid=7880): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7880)] 16:53:05.952171 run osmo-nitb_10.42.42.2(pid=7880): stdout: | (launched: 2022-12-13_16:53:05.580876) 16:53:06.087820 run osmo-nitb_10.42.42.2(pid=7880): stderr: | (launched: 2022-12-13_16:53:05.629713) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:53:06.223861 run osmo-nitb_10.42.42.2(pid=7880): stdout: | (launched: 2022-12-13_16:53:05.580876) 16:53:06.353848 run osmo-nitb_10.42.42.2(pid=7880): stderr: | (launched: 2022-12-13_16:53:05.629713) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:53:06.509895 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=7880): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7880) [trial-2391↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7880)] [trial-2391↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 16:53:06.518577 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 16:53:06.525734 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7879): Terminating (SIGTERM) 16:53:06.736649 --- ParallelTerminationStrategy: PID 7879 died... 16:53:06.756895 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7879): Terminated: ok {rc=0} 16:53:06.845069 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 16:53:07.932257 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:53:07.943499 tst nitb_smpp: Using 1 x bts (candidates: 1) 16:53:07.984370 tst esme_ms_sms_transaction.py: using LAC 34967 16:53:08.114068 tst esme_ms_sms_transaction.py: using RAC 32 16:53:08.240013 tst esme_ms_sms_transaction.py: using CellId 34967 16:53:08.366524 tst esme_ms_sms_transaction.py: using BVCI 34968 16:53:08.477504 tst nitb_smpp: Using 1 x modem (candidates: 1) 16:53:08.602258 tst esme_ms_sms_transaction.py: using MSISDN 8232 16:53:08.711899 tst esme_ms_sms_transaction.py:18: start nitb and bts... 16:53:08.915725 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:53:09.532773 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7881): Launched 16:53:09.838126 run osmo-nitb_10.42.42.2(pid=7882): Launched 16:53:10.006881 run osmo-nitb_10.42.42.2(pid=7882): ERR: Terminated: ERROR {rc=2} [trial-2391↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7882)] 16:53:10.143400 run osmo-nitb_10.42.42.2(pid=7882): stdout: | (launched: 2022-12-13_16:53:09.781202) 16:53:10.281199 run osmo-nitb_10.42.42.2(pid=7882): stderr: | (launched: 2022-12-13_16:53:09.826472) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:53:10.419764 run osmo-nitb_10.42.42.2(pid=7882): stdout: | (launched: 2022-12-13_16:53:09.781202) 16:53:10.551491 run osmo-nitb_10.42.42.2(pid=7882): stderr: | (launched: 2022-12-13_16:53:09.826472) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f287e42a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7882): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7882) [trial-2391↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7882)] 16:53:10.952873 tst osmo-nitb_10.42.42.2(pid=7882): stdout: | (launched: 2022-12-13_16:53:09.781202) 16:53:11.075622 tst osmo-nitb_10.42.42.2(pid=7882): stderr: | (launched: 2022-12-13_16:53:09.826472) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:53:11.220355 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=7882): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7882) [trial-2391↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7882)] [trial-2391↪nitb_smpp↪esme_ms_sms_transaction.py:21] 16:53:11.228727 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 16:53:11.235275 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7881): Terminating (SIGTERM) 16:53:11.443699 --- ParallelTerminationStrategy: PID 7881 died... 16:53:11.464315 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7881): Terminated: ok {rc=0} 16:53:11.551086 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 smpp --------------------------------------------------------------------- 16:53:12.716413 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:53:12.719180 tst smpp: Verifying 1 x bts (candidates: 11) 16:53:12.739905 tst smpp: Verifying 6 x ip_address (candidates: 9) 16:53:12.766729 tst smpp: Verifying 1 x modem (candidates: 12) 16:53:12.801690 tst smpp: Reserving 1 x bts (candidates: 11) 16:53:12.822298 tst smpp: Reserving 6 x ip_address (candidates: 9) 16:53:12.848583 tst smpp: Reserving 1 x modem (candidates: 12) 16:53:13.377062 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2391 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 16:53:13.381954 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:13.392225 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:13.402458 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:13.412582 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:13.435216 tst esme_connect_policy_acceptall.py: using MSISDN 8233 16:53:13.545719 run osmo-stp_10.42.42.4: Starting osmo-stp 16:53:14.063279 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7886): Launched 16:53:14.367242 run osmo-stp_10.42.42.4(pid=7887): Launched 16:53:14.484329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:53:14.955209 run create_hlr_db(pid=7888): Launched 16:53:15.081325 bus /sierra_2: Setting Powered False 16:53:16.158398 run create_hlr_db(pid=7888): Terminated: ok {rc=0} 16:53:16.633729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7890): Launched 16:53:17.038485 run osmo-hlr_10.42.42.2(pid=7891): Launched 16:53:17.284295 run osmo-msc_10.42.42.5: Starting osmo-msc 16:53:17.892662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7893): Launched 16:53:18.222764 run osmo-msc_10.42.42.5(pid=7894): Launched 16:53:18.407794 run osmo-hlr_10.42.42.2(pid=7891): ERR: Terminated: ERROR {rc=237} [trial-2391↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7891)] 16:53:18.547042 run osmo-hlr_10.42.42.2(pid=7891): stdout: | (launched: 2022-12-13_16:53:16.978076) 16:53:18.687244 run osmo-hlr_10.42.42.2(pid=7891): stderr: | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165317263 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165317288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165317288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165317288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:18.826164 run osmo-hlr_10.42.42.2(pid=7891): stdout: | (launched: 2022-12-13_16:53:16.978076) 16:53:18.958073 run osmo-hlr_10.42.42.2(pid=7891): stderr: | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165317250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165317263 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165317288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165317288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165317288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:19.115471 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=7891): Process ended prematurely: osmo-hlr_10.42.42.2(pid=7891) [trial-2391↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7891)] [trial-2391↪smpp↪esme_connect_policy_acceptall.py:23] 16:53:19.124392 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.7 sec) 16:53:19.151858 run osmo-msc_10.42.42.5(pid=7894): ERR: Terminated: ERROR {rc=9} [trial-2391↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=7894)] 16:53:19.203295 run osmo-msc_10.42.42.5(pid=7894): stdout: | (launched: 2022-12-13_16:53:18.162720) 16:53:19.255949 run osmo-msc_10.42.42.5(pid=7894): stderr: | [0;m[38;5;43m20221213165318526 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221213165318526 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221213165318526 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221213165318526 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221213165318526 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221213165318526 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221213165318526 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221213165318527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213165318527 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 16:53:19.309083 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7886): Terminating (SIGTERM) 16:53:19.351063 run osmo-stp_10.42.42.4(pid=7887): Terminating (SIGTERM) 16:53:19.393243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7890): Terminating (SIGTERM) 16:53:19.437074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7893): Terminating (SIGTERM) 16:53:19.482227 --- ParallelTerminationStrategy: PID 7886 died... 16:53:19.502901 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7886): Terminated: ok {rc=0} 16:53:19.551415 --- ParallelTerminationStrategy: PID 7887 died... 16:53:19.571355 run osmo-stp_10.42.42.4(pid=7887): Terminated: ok {rc=0} 16:53:19.617901 --- ParallelTerminationStrategy: PID 7890 died... 16:53:19.637741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7890): Terminated: ok {rc=0} 16:53:19.684398 --- ParallelTerminationStrategy: PID 7893 died... 16:53:19.704462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7893): Terminated: ok {rc=0} ---------------------------------------------- trial-2391 smpp esme_connect_policy_closed.py ---------------------------------------------- 16:53:19.756143 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:19.767837 tst smpp: Using 1 x bts (candidates: 1) 16:53:19.803726 tst esme_connect_policy_closed.py: using LAC 34968 16:53:19.935166 tst esme_connect_policy_closed.py: using RAC 33 16:53:20.065772 tst esme_connect_policy_closed.py: using CellId 34968 16:53:20.194452 tst esme_connect_policy_closed.py: using BVCI 34969 16:53:20.307060 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:20.318125 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:20.328562 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:20.346784 tst esme_connect_policy_closed.py: using MSISDN 8234 16:53:20.469007 tst esme_connect_policy_closed.py: using MSISDN 8235 16:53:20.580924 run osmo-stp_10.42.42.4: Starting osmo-stp 16:53:21.107134 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7897): Launched 16:53:21.417378 run osmo-stp_10.42.42.4(pid=7898): Launched 16:53:21.536428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:53:22.014605 run create_hlr_db(pid=7899): Launched 16:53:23.196937 run create_hlr_db(pid=7899): Terminated: ok {rc=0} 16:53:23.523049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7901): Launched 16:53:23.833258 run osmo-hlr_10.42.42.2(pid=7902): Launched 16:53:23.950527 run osmo-msc_10.42.42.5: Starting osmo-msc 16:53:24.523273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7904): Launched 16:53:24.834880 run osmo-msc_10.42.42.5(pid=7905): Launched 16:53:25.008777 run osmo-hlr_10.42.42.2(pid=7902): ERR: Terminated: ERROR {rc=237} [trial-2391↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7902)] 16:53:25.147881 run osmo-hlr_10.42.42.2(pid=7902): stdout: | (launched: 2022-12-13_16:53:23.775809) 16:53:25.290656 run osmo-hlr_10.42.42.2(pid=7902): stderr: | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165323962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165323970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165323970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165323970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:25.428735 run osmo-hlr_10.42.42.2(pid=7902): stdout: | (launched: 2022-12-13_16:53:23.775809) 16:53:25.560763 run osmo-hlr_10.42.42.2(pid=7902): stderr: | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165323950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165323962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165323970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165323970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165323970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:25.718958 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=7902): Process ended prematurely: osmo-hlr_10.42.42.2(pid=7902) [trial-2391↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7902)] [trial-2391↪smpp↪esme_connect_policy_closed.py:31] 16:53:25.727993 tst esme_connect_policy_closed.py:31: Test FAILED (6.0 sec) 16:53:25.755955 run osmo-msc_10.42.42.5(pid=7905): ERR: Terminated: ERROR {rc=9} [trial-2391↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=7905)] 16:53:25.806911 run osmo-msc_10.42.42.5(pid=7905): stdout: | (launched: 2022-12-13_16:53:24.777541) 16:53:25.859190 run osmo-msc_10.42.42.5(pid=7905): stderr: | [0;m[38;5;43m20221213165325094 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221213165325094 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221213165325095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221213165325095 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221213165325095 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221213165325095 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221213165325095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221213165325095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213165325095 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 16:53:25.911897 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7897): Terminating (SIGTERM) 16:53:25.953856 run osmo-stp_10.42.42.4(pid=7898): Terminating (SIGTERM) 16:53:25.996081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7901): Terminating (SIGTERM) 16:53:26.039699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7904): Terminating (SIGTERM) 16:53:26.084231 --- ParallelTerminationStrategy: PID 7897 died... 16:53:26.105188 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7897): Terminated: ok {rc=0} 16:53:26.152735 --- ParallelTerminationStrategy: PID 7898 died... 16:53:26.172704 run osmo-stp_10.42.42.4(pid=7898): Terminated: ok {rc=0} 16:53:26.219123 --- ParallelTerminationStrategy: PID 7901 died... 16:53:26.239057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7901): Terminated: ok {rc=0} 16:53:26.285665 --- ParallelTerminationStrategy: PID 7904 died... 16:53:26.305526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7904): Terminated: ok {rc=0} ---------------------------------------------- trial-2391 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 16:53:26.357282 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:26.369666 tst smpp: Using 1 x bts (candidates: 1) 16:53:26.406972 tst esme_ms_sms_storeforward.py: using LAC 34969 16:53:26.533547 tst esme_ms_sms_storeforward.py: using RAC 34 16:53:26.657473 tst esme_ms_sms_storeforward.py: using CellId 34969 16:53:26.781469 tst esme_ms_sms_storeforward.py: using BVCI 34970 16:53:26.896323 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:26.906915 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:26.917342 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:26.927666 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:26.938097 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:26.948863 tst smpp: Using 1 x modem (candidates: 1) 16:53:27.081820 tst esme_ms_sms_storeforward.py: using MSISDN 8236 16:53:27.203954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:53:27.716511 run create_hlr_db(pid=7908): Launched 16:53:28.901823 run create_hlr_db(pid=7908): Terminated: ok {rc=0} 16:53:29.250119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7910): Launched 16:53:29.582064 run osmo-hlr_10.42.42.2(pid=7911): Launched 16:53:29.709400 run osmo-stp_10.42.42.5: Starting osmo-stp 16:53:30.284308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7913): Launched 16:53:30.617236 run osmo-stp_10.42.42.5(pid=7914): Launched 16:53:30.744293 run osmo-msc_10.42.42.6: Starting osmo-msc 16:53:31.399041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7916): Launched 16:53:31.742732 run osmo-msc_10.42.42.6(pid=7917): Launched 16:53:32.203310 run osmo-stp_10.42.42.5(pid=7914): ERR: Terminated: ERROR {rc=1} [trial-2391↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7914)] 16:53:32.349198 run osmo-stp_10.42.42.5(pid=7914): stdout: | (launched: 2022-12-13_16:53:30.555990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:32.486710 run osmo-stp_10.42.42.5(pid=7914): stderr: | [0;m[38;5;43m20221213165330748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165330748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165330749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165330749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165330749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165330750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165330750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:32.624474 run osmo-stp_10.42.42.5(pid=7914): stdout: | (launched: 2022-12-13_16:53:30.555990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:32.756145 run osmo-stp_10.42.42.5(pid=7914): stderr: | [0;m[38;5;43m20221213165330748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165330748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165330749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165330749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165330749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165330750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165330750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:32.914294 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=7914): Process ended prematurely: osmo-stp_10.42.42.5(pid=7914) [trial-2391↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7914)] [trial-2391↪smpp↪esme_ms_sms_storeforward.py:30] 16:53:32.923631 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.6 sec) 16:53:32.951532 run osmo-hlr_10.42.42.2(pid=7911): ERR: Terminated: ERROR {rc=237} [trial-2391↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7911)] 16:53:33.002506 run osmo-hlr_10.42.42.2(pid=7911): stdout: | (launched: 2022-12-13_16:53:29.521392) 16:53:33.055412 run osmo-hlr_10.42.42.2(pid=7911): stderr: | [0;m[1;31m20221213165329719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165329719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165329719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165329719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165329719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165329720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165329731 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165329740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165329740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165329740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:33.128590 run osmo-msc_10.42.42.6(pid=7917): ERR: Terminated: ERROR {rc=2} [trial-2391↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7917)] 16:53:33.179116 run osmo-msc_10.42.42.6(pid=7917): stdout: | (launched: 2022-12-13_16:53:31.674579) 16:53:33.232043 run osmo-msc_10.42.42.6(pid=7917): stderr: | [0;m[38;5;43m20221213165332018 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165332018 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f94fc11ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165332018 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165332018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165332018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165332019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165332020 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165332021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165332021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165332021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:53:33.285236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7910): Terminating (SIGTERM) 16:53:33.327639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7913): Terminating (SIGTERM) 16:53:33.370810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7916): Terminating (SIGTERM) 16:53:33.413780 --- ParallelTerminationStrategy: PID 7910 died... 16:53:33.434302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7910): Terminated: ok {rc=0} 16:53:33.481321 --- ParallelTerminationStrategy: PID 7913 died... 16:53:33.501449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7913): Terminated: ok {rc=0} 16:53:33.548086 --- ParallelTerminationStrategy: PID 7916 died... 16:53:33.568229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7916): Terminated: ok {rc=0} 16:53:33.657510 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 smpp esme_ms_sms_transaction.py ---------------------------------------------- 16:53:34.745330 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:34.757167 tst smpp: Using 1 x bts (candidates: 1) 16:53:34.791584 tst esme_ms_sms_transaction.py: using LAC 34970 16:53:34.921801 tst esme_ms_sms_transaction.py: using RAC 35 16:53:35.050343 tst esme_ms_sms_transaction.py: using CellId 34970 16:53:35.179227 tst esme_ms_sms_transaction.py: using BVCI 34971 16:53:35.300816 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:35.311848 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:35.322723 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:35.333563 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:35.344660 tst smpp: Using 1 x ip_address (candidates: 6) 16:53:35.355801 tst smpp: Using 1 x modem (candidates: 1) 16:53:35.488448 tst esme_ms_sms_transaction.py: using MSISDN 8237 16:53:35.609457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:53:36.122019 run create_hlr_db(pid=7919): Launched 16:53:36.250144 bus /sierra_2: Setting Powered False 16:53:37.314526 run create_hlr_db(pid=7919): Terminated: ok {rc=0} 16:53:37.756827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7921): Launched 16:53:38.068168 run osmo-hlr_10.42.42.2(pid=7922): Launched 16:53:38.186228 run osmo-stp_10.42.42.5: Starting osmo-stp 16:53:38.716682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7924): Launched 16:53:39.025460 run osmo-stp_10.42.42.5(pid=7925): Launched 16:53:39.142628 run osmo-msc_10.42.42.6: Starting osmo-msc 16:53:39.700039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7927): Launched 16:53:40.010983 run osmo-msc_10.42.42.6(pid=7928): Launched 16:53:40.184885 run osmo-stp_10.42.42.5(pid=7925): ERR: Terminated: ERROR {rc=1} [trial-2391↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7925)] 16:53:40.315451 run osmo-stp_10.42.42.5(pid=7925): stdout: | (launched: 2022-12-13_16:53:38.968784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:40.446687 run osmo-stp_10.42.42.5(pid=7925): stderr: | [0;m[38;5;43m20221213165339140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165339140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165339140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165339141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165339141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165339142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165339142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:40.575595 run osmo-stp_10.42.42.5(pid=7925): stdout: | (launched: 2022-12-13_16:53:38.968784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:40.699114 run osmo-stp_10.42.42.5(pid=7925): stderr: | [0;m[38;5;43m20221213165339140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165339140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165339140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165339141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165339141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165339142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165339142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:40.846891 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=7925): Process ended prematurely: osmo-stp_10.42.42.5(pid=7925) [trial-2391↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7925)] [trial-2391↪smpp↪esme_ms_sms_transaction.py:28] 16:53:40.855241 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 16:53:40.881285 run osmo-hlr_10.42.42.2(pid=7922): ERR: Terminated: ERROR {rc=237} [trial-2391↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7922)] 16:53:40.929586 run osmo-hlr_10.42.42.2(pid=7922): stdout: | (launched: 2022-12-13_16:53:38.011405) 16:53:40.978996 run osmo-hlr_10.42.42.2(pid=7922): stderr: | [0;m[1;31m20221213165338186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165338186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165338186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165338186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165338186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165338186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165338198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165338206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165338207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165338207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:41.048295 run osmo-msc_10.42.42.6(pid=7928): ERR: Terminated: ERROR {rc=2} [trial-2391↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7928)] 16:53:41.095643 run osmo-msc_10.42.42.6(pid=7928): stdout: | (launched: 2022-12-13_16:53:39.953340) 16:53:41.144831 run osmo-msc_10.42.42.6(pid=7928): stderr: | [0;m[38;5;43m20221213165340225 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165340226 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6514915c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165340226 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165340226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165340226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165340226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165340228 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165340228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165340229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165340229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:53:41.194475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7921): Terminating (SIGTERM) 16:53:41.234000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7924): Terminating (SIGTERM) 16:53:41.273471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7927): Terminating (SIGTERM) 16:53:41.313801 --- ParallelTerminationStrategy: PID 7921 died... 16:53:41.333229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7921): Terminated: ok {rc=0} 16:53:41.377264 --- ParallelTerminationStrategy: PID 7924 died... 16:53:41.395856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7924): Terminated: ok {rc=0} 16:53:41.439710 --- ParallelTerminationStrategy: PID 7927 died... 16:53:41.458504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7927): Terminated: ok {rc=0} 16:53:41.544516 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 encryption --------------------------------------------------------------------- 16:53:42.736352 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:53:42.739243 tst encryption: Verifying 1 x bts (candidates: 11) 16:53:42.760232 tst encryption: Verifying 6 x ip_address (candidates: 9) 16:53:42.787035 tst encryption: Verifying 1 x modem (candidates: 12) 16:53:42.822162 tst encryption: Reserving 1 x bts (candidates: 11) 16:53:42.843082 tst encryption: Reserving 6 x ip_address (candidates: 9) 16:53:42.869718 tst encryption: Reserving 1 x modem (candidates: 12) 16:53:43.398365 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2391 encryption register_a5_0_authopt.py ---------------------------------------------- 16:53:43.450658 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:43.461214 tst encryption: Using 1 x bts (candidates: 1) 16:53:43.499699 tst register_a5_0_authopt.py: using LAC 34971 16:53:43.623698 tst register_a5_0_authopt.py: using RAC 36 16:53:43.746511 tst register_a5_0_authopt.py: using CellId 34971 16:53:43.869404 tst register_a5_0_authopt.py: using BVCI 34972 16:53:43.984865 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:43.995405 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:44.005846 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:44.016184 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:44.026656 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:44.037017 tst encryption: Using 1 x modem (candidates: 1) 16:53:44.158464 tst register_a5_0_authopt.py:8: start network... 16:53:44.386071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:53:44.905694 run create_hlr_db(pid=7934): Launched 16:53:45.036898 bus /sierra_2: Setting Powered False 16:53:46.103586 run create_hlr_db(pid=7934): Terminated: ok {rc=0} 16:53:46.601818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7936): Launched 16:53:46.944675 run osmo-hlr_10.42.42.2(pid=7937): Launched 16:53:47.259427 run osmo-stp_10.42.42.5: Starting osmo-stp 16:53:48.030108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7988): Launched 16:53:48.429629 run osmo-stp_10.42.42.5(pid=8013): Launched 16:53:48.749140 run osmo-msc_10.42.42.6: Starting osmo-msc 16:53:49.558556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8164): Launched 16:53:49.956824 run osmo-msc_10.42.42.6(pid=8212): Launched 16:53:50.259585 run osmo-stp_10.42.42.5(pid=8013): ERR: Terminated: ERROR {rc=1} [trial-2391↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8013)] 16:53:50.527469 run osmo-stp_10.42.42.5(pid=8013): stdout: | (launched: 2022-12-13_16:53:48.355210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:50.781256 run osmo-stp_10.42.42.5(pid=8013): stderr: | [0;m[38;5;43m20221213165348692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165348692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165348693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165348693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165348694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165348694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165348694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:50.925356 run osmo-stp_10.42.42.5(pid=8013): stdout: | (launched: 2022-12-13_16:53:48.355210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:51.062072 run osmo-stp_10.42.42.5(pid=8013): stderr: | [0;m[38;5;43m20221213165348692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165348692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165348693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165348693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165348694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165348694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165348694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:51.225678 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8013): Process ended prematurely: osmo-stp_10.42.42.5(pid=8013) [trial-2391↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8013)] [trial-2391↪encryption↪register_a5_0_authopt.py:8] 16:53:51.236394 tst register_a5_0_authopt.py:8: Test FAILED (7.8 sec) 16:53:51.265646 run osmo-hlr_10.42.42.2(pid=7937): ERR: Terminated: ERROR {rc=237} [trial-2391↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7937)] 16:53:51.320940 run osmo-hlr_10.42.42.2(pid=7937): stdout: | (launched: 2022-12-13_16:53:46.883641) 16:53:51.376213 run osmo-hlr_10.42.42.2(pid=7937): stderr: | [0;m[1;31m20221213165347203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165347203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165347204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165347204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165347204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165347204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165347221 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165347246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165347246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165347246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:51.451723 run osmo-msc_10.42.42.6(pid=8212): ERR: Terminated: ERROR {rc=2} [trial-2391↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8212)] 16:53:51.503364 run osmo-msc_10.42.42.6(pid=8212): stdout: | (launched: 2022-12-13_16:53:49.886069) 16:53:51.561543 run osmo-msc_10.42.42.6(pid=8212): stderr: | [0;m[38;5;43m20221213165350474 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165350474 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8fbb8d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165350475 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165350475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165350475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165350475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165350477 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165350477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165350477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165350477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:53:51.616916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7936): Terminating (SIGTERM) 16:53:51.660767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7988): Terminating (SIGTERM) 16:53:51.708135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8164): Terminating (SIGTERM) 16:53:51.754183 --- ParallelTerminationStrategy: PID 7936 died... 16:53:51.776127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7936): Terminated: ok {rc=0} 16:53:51.824656 --- ParallelTerminationStrategy: PID 7988 died... 16:53:51.846356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7988): Terminated: ok {rc=0} 16:53:51.895592 --- ParallelTerminationStrategy: PID 8164 died... 16:53:51.917672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8164): Terminated: ok {rc=0} 16:53:52.010312 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 encryption register_a5_0_authreq.py ---------------------------------------------- 16:53:53.173616 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:53.186394 tst encryption: Using 1 x bts (candidates: 1) 16:53:53.224060 tst register_a5_0_authreq.py: using LAC 34972 16:53:53.364555 tst register_a5_0_authreq.py: using RAC 37 16:53:53.499030 tst register_a5_0_authreq.py: using CellId 34972 16:53:53.630566 tst register_a5_0_authreq.py: using BVCI 34973 16:53:53.757641 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:53.769743 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:53.781720 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:53.793773 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:53.806878 tst encryption: Using 1 x ip_address (candidates: 6) 16:53:53.819887 tst encryption: Using 1 x modem (candidates: 1) 16:53:53.951531 tst register_a5_0_authreq.py:8: start network... 16:53:54.183793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:53:54.714961 run create_hlr_db(pid=8217): Launched 16:53:54.884682 bus /sierra_2: Setting Powered False 16:53:55.952378 run create_hlr_db(pid=8217): Terminated: ok {rc=0} 16:53:56.431262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8219): Launched 16:53:56.792449 run osmo-hlr_10.42.42.2(pid=8220): Launched 16:53:57.053472 run osmo-stp_10.42.42.5: Starting osmo-stp 16:53:57.746468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8222): Launched 16:53:58.107193 run osmo-stp_10.42.42.5(pid=8223): Launched 16:53:58.371205 run osmo-msc_10.42.42.6: Starting osmo-msc 16:53:59.063211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8225): Launched 16:53:59.423860 run osmo-msc_10.42.42.6(pid=8226): Launched 16:53:59.815397 run osmo-stp_10.42.42.5(pid=8223): ERR: Terminated: ERROR {rc=1} [trial-2391↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8223)] 16:54:00.119697 run osmo-stp_10.42.42.5(pid=8223): stdout: | (launched: 2022-12-13_16:53:58.043892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:00.274015 run osmo-stp_10.42.42.5(pid=8223): stderr: | [0;m[38;5;43m20221213165358337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165358337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165358337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165358338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165358338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165358338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165358338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:00.420817 run osmo-stp_10.42.42.5(pid=8223): stdout: | (launched: 2022-12-13_16:53:58.043892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:00.563187 run osmo-stp_10.42.42.5(pid=8223): stderr: | [0;m[38;5;43m20221213165358337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165358337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165358337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165358338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165358338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165358338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165358338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:00.731425 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8223): Process ended prematurely: osmo-stp_10.42.42.5(pid=8223) [trial-2391↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8223)] [trial-2391↪encryption↪register_a5_0_authreq.py:8] 16:54:00.742457 tst register_a5_0_authreq.py:8: Test FAILED (7.6 sec) 16:54:00.772453 run osmo-hlr_10.42.42.2(pid=8220): ERR: Terminated: ERROR {rc=237} [trial-2391↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8220)] 16:54:00.831928 run osmo-hlr_10.42.42.2(pid=8220): stdout: | (launched: 2022-12-13_16:53:56.731290) 16:54:00.889901 run osmo-hlr_10.42.42.2(pid=8220): stderr: | [0;m[1;31m20221213165357037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165357037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165357037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165357037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165357037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165357037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165357058 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165357071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165357071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165357071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:00.986440 run osmo-msc_10.42.42.6(pid=8226): ERR: Terminated: ERROR {rc=2} [trial-2391↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8226)] 16:54:01.040058 run osmo-msc_10.42.42.6(pid=8226): stdout: | (launched: 2022-12-13_16:53:59.361323) 16:54:01.096201 run osmo-msc_10.42.42.6(pid=8226): stderr: | [0;m[38;5;43m20221213165359862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165359862 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9323e60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165359862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165359862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165359862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165359862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165359869 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165359869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165359869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165359869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:01.152220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8219): Terminating (SIGTERM) 16:54:01.196395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8222): Terminating (SIGTERM) 16:54:01.247098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8225): Terminating (SIGTERM) 16:54:01.318300 --- ParallelTerminationStrategy: PID 8219 died... 16:54:01.358449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8219): Terminated: ok {rc=0} 16:54:01.443039 --- ParallelTerminationStrategy: PID 8222 died... 16:54:01.475785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8222): Terminated: ok {rc=0} 16:54:01.542291 --- ParallelTerminationStrategy: PID 8225 died... 16:54:01.568383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8225): Terminated: ok {rc=0} 16:54:01.683034 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 encryption register_a5_1_authreq.py ---------------------------------------------- 16:54:02.869940 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:02.883135 tst encryption: Using 1 x bts (candidates: 1) 16:54:02.922604 tst register_a5_1_authreq.py: using LAC 34973 16:54:03.059897 tst register_a5_1_authreq.py: using RAC 38 16:54:03.194845 tst register_a5_1_authreq.py: using CellId 34973 16:54:03.332432 tst register_a5_1_authreq.py: using BVCI 34974 16:54:03.461609 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:03.473748 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:03.486094 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:03.498120 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:03.511586 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:03.525004 tst encryption: Using 1 x modem (candidates: 1) 16:54:03.654220 tst register_a5_1_authreq.py:8: start network... 16:54:03.894577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:04.436778 run create_hlr_db(pid=8228): Launched 16:54:04.601165 bus /sierra_2: Setting Powered False 16:54:05.670897 run create_hlr_db(pid=8228): Terminated: ok {rc=0} 16:54:06.160593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8230): Launched 16:54:06.525698 run osmo-hlr_10.42.42.2(pid=8231): Launched 16:54:06.784662 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:07.489978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8233): Launched 16:54:07.851127 run osmo-stp_10.42.42.5(pid=8234): Launched 16:54:08.112303 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:08.815717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8236): Launched 16:54:09.178543 run osmo-msc_10.42.42.6(pid=8237): Launched 16:54:09.573105 run osmo-stp_10.42.42.5(pid=8234): ERR: Terminated: ERROR {rc=1} [trial-2391↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8234)] 16:54:09.879603 run osmo-stp_10.42.42.5(pid=8234): stdout: | (launched: 2022-12-13_16:54:07.788466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:10.027519 run osmo-stp_10.42.42.5(pid=8234): stderr: | [0;m[38;5;43m20221213165408089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165408090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165408090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165408090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165408091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165408091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165408091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:10.172809 run osmo-stp_10.42.42.5(pid=8234): stdout: | (launched: 2022-12-13_16:54:07.788466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:10.298458 run osmo-stp_10.42.42.5(pid=8234): stderr: | [0;m[38;5;43m20221213165408089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165408090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165408090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165408090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165408091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165408091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165408091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:10.448502 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8234): Process ended prematurely: osmo-stp_10.42.42.5(pid=8234) [trial-2391↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8234)] [trial-2391↪encryption↪register_a5_1_authreq.py:8] 16:54:10.457668 tst register_a5_1_authreq.py:8: Test FAILED (7.6 sec) 16:54:10.484620 run osmo-hlr_10.42.42.2(pid=8231): ERR: Terminated: ERROR {rc=237} [trial-2391↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8231)] 16:54:10.532524 run osmo-hlr_10.42.42.2(pid=8231): stdout: | (launched: 2022-12-13_16:54:06.462247) 16:54:10.582478 run osmo-hlr_10.42.42.2(pid=8231): stderr: | [0;m[1;31m20221213165406764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165406764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165406764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165406769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165406769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165406769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165406787 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165406795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165406795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165406795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:10.651797 run osmo-msc_10.42.42.6(pid=8237): ERR: Terminated: ERROR {rc=2} [trial-2391↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8237)] 16:54:10.699669 run osmo-msc_10.42.42.6(pid=8237): stdout: | (launched: 2022-12-13_16:54:09.115354) 16:54:10.749387 run osmo-msc_10.42.42.6(pid=8237): stderr: | [0;m[38;5;43m20221213165409624 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165409624 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2b6600fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165409624 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165409624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165409624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165409625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165409626 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165409627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165409627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165409627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:10.799411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8230): Terminating (SIGTERM) 16:54:10.839482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8233): Terminating (SIGTERM) 16:54:10.880231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8236): Terminating (SIGTERM) 16:54:10.920512 --- ParallelTerminationStrategy: PID 8230 died... 16:54:10.939711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8230): Terminated: ok {rc=0} 16:54:10.983559 --- ParallelTerminationStrategy: PID 8233 died... 16:54:11.002101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8233): Terminated: ok {rc=0} 16:54:11.046109 --- ParallelTerminationStrategy: PID 8236 died... 16:54:11.064988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8236): Terminated: ok {rc=0} 16:54:11.149935 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2391 encryption register_a5_3_authreq.py ---------------------------------------------- 16:54:12.303753 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:12.315969 tst encryption: Using 1 x bts (candidates: 1) 16:54:12.353520 tst register_a5_3_authreq.py: using LAC 34974 16:54:12.488796 tst register_a5_3_authreq.py: using RAC 39 16:54:12.625281 tst register_a5_3_authreq.py: using CellId 34974 16:54:12.751056 tst register_a5_3_authreq.py: using BVCI 34975 16:54:12.868698 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:12.879904 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:12.890730 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:12.901428 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:12.912538 tst encryption: Using 1 x ip_address (candidates: 6) 16:54:12.923620 tst encryption: Using 1 x modem (candidates: 1) 16:54:13.058651 tst register_a5_3_authreq.py:8: start network... 16:54:13.288159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:13.811639 run create_hlr_db(pid=8239): Launched 16:54:13.942688 bus /sierra_2: Setting Powered False 16:54:15.008889 run create_hlr_db(pid=8239): Terminated: ok {rc=0} 16:54:15.479278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8241): Launched 16:54:15.817749 run osmo-hlr_10.42.42.2(pid=8242): Launched 16:54:16.041240 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:16.672089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8244): Launched 16:54:17.017597 run osmo-stp_10.42.42.5(pid=8245): Launched 16:54:17.303152 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:17.915080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8247): Launched 16:54:18.254617 run osmo-msc_10.42.42.6(pid=8248): Launched 16:54:18.443270 run osmo-stp_10.42.42.5(pid=8245): ERR: Terminated: ERROR {rc=1} [trial-2391↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8245)] 16:54:18.585144 run osmo-stp_10.42.42.5(pid=8245): stdout: | (launched: 2022-12-13_16:54:16.955312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:18.727881 run osmo-stp_10.42.42.5(pid=8245): stderr: | [0;m[38;5;43m20221213165417135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165417136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165417136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165417136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165417137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165417137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165417137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:18.868897 run osmo-stp_10.42.42.5(pid=8245): stdout: | (launched: 2022-12-13_16:54:16.955312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:19.004552 run osmo-stp_10.42.42.5(pid=8245): stderr: | [0;m[38;5;43m20221213165417135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165417136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165417136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165417136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165417137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165417137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165417137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:19.165960 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8245): Process ended prematurely: osmo-stp_10.42.42.5(pid=8245) [trial-2391↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8245)] [trial-2391↪encryption↪register_a5_3_authreq.py:8] 16:54:19.175872 tst register_a5_3_authreq.py:8: Test FAILED (6.9 sec) 16:54:19.203822 run osmo-hlr_10.42.42.2(pid=8242): ERR: Terminated: ERROR {rc=237} [trial-2391↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8242)] 16:54:19.254688 run osmo-hlr_10.42.42.2(pid=8242): stdout: | (launched: 2022-12-13_16:54:15.755854) 16:54:19.307376 run osmo-hlr_10.42.42.2(pid=8242): stderr: | [0;m[1;31m20221213165416007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165416007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165416007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165416007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165416007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165416008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165416030 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165416047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165416047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165416047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:19.380616 run osmo-msc_10.42.42.6(pid=8248): ERR: Terminated: ERROR {rc=2} [trial-2391↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8248)] 16:54:19.430596 run osmo-msc_10.42.42.6(pid=8248): stdout: | (launched: 2022-12-13_16:54:18.192580) 16:54:19.483030 run osmo-msc_10.42.42.6(pid=8248): stderr: | [0;m[38;5;43m20221213165418520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165418520 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7dab5bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165418520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165418520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165418520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165418521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165418522 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165418523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165418523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165418523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:19.535596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8241): Terminating (SIGTERM) 16:54:19.577924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8244): Terminating (SIGTERM) 16:54:19.620386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8247): Terminating (SIGTERM) 16:54:19.663671 --- ParallelTerminationStrategy: PID 8241 died... 16:54:19.684051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8241): Terminated: ok {rc=0} 16:54:19.730558 --- ParallelTerminationStrategy: PID 8244 died... 16:54:19.750436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8244): Terminated: ok {rc=0} 16:54:19.796844 --- ParallelTerminationStrategy: PID 8247 died... 16:54:19.817255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8247): Terminated: ok {rc=0} 16:54:19.906229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 16:54:21.117619 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:21.122998 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 16:54:21.141889 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 16:54:21.169796 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 16:54:21.198110 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 16:54:21.217641 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 16:54:21.244919 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 16:54:21.756714 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2391 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 16:54:21.761608 tst handover.py:11: TEST_CONFIG: {} 16:54:21.989166 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:54:22.005852 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:54:22.029741 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:54:22.084734 tst handover.py: using MSISDN 8238 16:54:22.209416 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8238', subscriber_id=0} 16:54:22.327460 run srsepc_10.42.42.118: Starting srsepc 16:54:24.270152 run rm-remote-dir(pid=8255): Launched 16:54:24.406724 bus /sierra_2: Setting Powered False 16:54:25.477487 run rm-remote-dir(pid=8255): Terminated: ok {rc=0} 16:54:25.944806 run mk-remote-dir(pid=8256): Launched 16:54:27.128224 run mk-remote-dir(pid=8256): Terminated: ok {rc=0} 16:54:27.427594 run scp-inst-to-remote(pid=8257): Launched 16:54:29.615278 run scp-inst-to-remote(pid=8257): Terminated: ok {rc=0} 16:54:29.983646 run rm-remote-dir(pid=8259): Launched 16:54:31.178608 run rm-remote-dir(pid=8259): Terminated: ok {rc=0} 16:54:31.558565 run mk-remote-dir(pid=8260): Launched 16:54:32.818995 run mk-remote-dir(pid=8260): Terminated: ok {rc=0} 16:54:33.135817 run scp-cfg-to-remote(pid=8261): Launched 16:54:34.330053 run scp-cfg-to-remote(pid=8261): Terminated: ok {rc=0} 16:54:34.642889 run scp-db-to-remote(pid=8263): Launched 16:54:35.836661 run scp-db-to-remote(pid=8263): Terminated: ok {rc=0} 16:54:35.981648 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:54:36.321998 run patchelf(pid=8265): Launched 16:54:37.518627 run patchelf(pid=8265): Terminated: ok {rc=0} 16:54:37.663633 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:54:38.004264 run setcap-netadm(pid=8266): Launched 16:54:39.198948 run setcap-netadm(pid=8266): Terminated: ok {rc=0} 16:54:39.554387 run srsepc(pid=8267): Launched 16:54:39.681579 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:54:40.891888 run rm-remote-dir(pid=8268): Launched 16:54:41.085816 run srsepc(pid=8267): ERR: Terminated: ERROR {rc=127} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8267)] 16:54:41.233252 run srsepc(pid=8267): stdout: | (launched: 2022-12-13_16:54:39.492431) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:54:41.380508 run srsepc(pid=8267): stderr: | (launched: 2022-12-13_16:54:39.542621) | Connection to 10.42.42.116 closed. 16:54:41.527779 run srsepc(pid=8267): stdout: | (launched: 2022-12-13_16:54:39.492431) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:54:41.669358 run srsepc(pid=8267): stderr: | (launched: 2022-12-13_16:54:39.542621) | Connection to 10.42.42.116 closed. 16:54:41.836872 run rm-remote-dir(pid=8268): Terminating (SIGINT) 16:54:42.031143 run rm-remote-dir(pid=8268): Terminated: ok {rc=0} 16:54:42.171617 tst handover.py:37: ERR: Error: srsepc(pid=8267): Process ended prematurely: srsepc(pid=8267) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8267)] [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 16:54:42.182512 tst handover.py:37: Test FAILED (20.4 sec) 16:54:42.265635 run scp-back-log(pid=8269): Launched 16:54:43.347809 run scp-back-log(pid=8269): ERR: Terminated: ERROR {rc=1} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8269)] 16:54:43.411735 run scp-back-log(pid=8269): stdout: | (launched: 2022-12-13_16:54:42.232202) 16:54:43.477297 run scp-back-log(pid=8269): stderr: | (launched: 2022-12-13_16:54:42.253060) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:54:43.551001 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8269): launch_sync(): local process exited with status 1 [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8269)]') ---------------------------------------------- trial-2391 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 16:54:43.598364 tst iperf3_bidir.py:13: Number of physical ue: 1 16:54:43.826029 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:54:43.870526 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 16:54:44.082160 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:54:44.098122 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:54:44.131156 tst iperf3_bidir.py: using MSISDN 8239 16:54:44.247927 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8239', subscriber_id=0} 16:54:44.358376 run srsepc_10.42.42.118: Starting srsepc 16:54:45.007153 run rm-remote-dir(pid=8271): Launched 16:54:46.211401 run rm-remote-dir(pid=8271): Terminated: ok {rc=0} 16:54:46.600682 run mk-remote-dir(pid=8272): Launched 16:54:47.841641 run mk-remote-dir(pid=8272): Terminated: ok {rc=0} 16:54:48.136870 run scp-inst-to-remote(pid=8273): Launched 16:54:50.322818 run scp-inst-to-remote(pid=8273): Terminated: ok {rc=0} 16:54:50.667986 run rm-remote-dir(pid=8275): Launched 16:54:51.853491 run rm-remote-dir(pid=8275): Terminated: ok {rc=0} 16:54:52.200017 run mk-remote-dir(pid=8277): Launched 16:54:53.386084 run mk-remote-dir(pid=8277): Terminated: ok {rc=0} 16:54:53.682073 run scp-cfg-to-remote(pid=8278): Launched 16:54:54.865230 run scp-cfg-to-remote(pid=8278): Terminated: ok {rc=0} 16:54:55.159513 run scp-db-to-remote(pid=8280): Launched 16:54:56.343057 run scp-db-to-remote(pid=8280): Terminated: ok {rc=0} 16:54:56.478418 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:54:56.796595 run patchelf(pid=8282): Launched 16:54:57.979993 run patchelf(pid=8282): Terminated: ok {rc=0} 16:54:58.115726 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:54:58.434943 run setcap-netadm(pid=8283): Launched 16:54:59.618119 run setcap-netadm(pid=8283): Terminated: ok {rc=0} 16:54:59.952167 run srsepc(pid=8284): Launched 16:55:00.071565 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:55:01.242249 run rm-remote-dir(pid=8285): Launched 16:55:01.495887 run srsepc(pid=8284): ERR: Terminated: ERROR {rc=127} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8284)] 16:55:01.669230 run srsepc(pid=8284): stdout: | (launched: 2022-12-13_16:54:59.893598) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:55:01.823862 run srsepc(pid=8284): stderr: | (launched: 2022-12-13_16:54:59.940687) | Connection to 10.42.42.116 closed. 16:55:01.988840 run srsepc(pid=8284): stdout: | (launched: 2022-12-13_16:54:59.893598) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:55:02.138768 run srsepc(pid=8284): stderr: | (launched: 2022-12-13_16:54:59.940687) | Connection to 10.42.42.116 closed. 16:55:02.313914 run rm-remote-dir(pid=8285): Terminating (SIGINT) 16:55:02.510499 run rm-remote-dir(pid=8285): Terminated: ok {rc=0} 16:55:02.651628 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=8284): Process ended prematurely: srsepc(pid=8284) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8284)] [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 16:55:02.663025 tst iperf3_bidir.py:42: Test FAILED (19.1 sec) 16:55:02.746338 run scp-back-log(pid=8289): Launched 16:55:03.826509 run scp-back-log(pid=8289): ERR: Terminated: ERROR {rc=1} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8289)] 16:55:03.891079 run scp-back-log(pid=8289): stdout: | (launched: 2022-12-13_16:55:02.713340) 16:55:03.957814 run scp-back-log(pid=8289): stderr: | (launched: 2022-12-13_16:55:02.734268) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:55:04.032204 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8289): launch_sync(): local process exited with status 1 [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8289)]') ---------------------------------------------- trial-2391 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 16:55:04.080418 tst iperf3_dl.py:13: Number of physical ue: 1 16:55:04.308229 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:55:04.355724 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 16:55:04.582196 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:55:04.599043 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:55:04.631807 tst iperf3_dl.py: using MSISDN 8240 16:55:04.757432 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8240', subscriber_id=0} 16:55:04.875268 run srsepc_10.42.42.118: Starting srsepc 16:55:05.563873 run rm-remote-dir(pid=8291): Launched 16:55:06.759074 run rm-remote-dir(pid=8291): Terminated: ok {rc=0} 16:55:07.127181 run mk-remote-dir(pid=8292): Launched 16:55:08.318110 run mk-remote-dir(pid=8292): Terminated: ok {rc=0} 16:55:08.612328 run scp-inst-to-remote(pid=8293): Launched 16:55:10.802143 run scp-inst-to-remote(pid=8293): Terminated: ok {rc=0} 16:55:11.168222 run rm-remote-dir(pid=8295): Launched 16:55:12.364706 run rm-remote-dir(pid=8295): Terminated: ok {rc=0} 16:55:12.732731 run mk-remote-dir(pid=8296): Launched 16:55:13.929580 run mk-remote-dir(pid=8296): Terminated: ok {rc=0} 16:55:14.243850 run scp-cfg-to-remote(pid=8297): Launched 16:55:15.437913 run scp-cfg-to-remote(pid=8297): Terminated: ok {rc=0} 16:55:15.750318 run scp-db-to-remote(pid=8299): Launched 16:55:16.968672 run scp-db-to-remote(pid=8299): Terminated: ok {rc=0} 16:55:17.116037 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:55:17.437873 run patchelf(pid=8301): Launched 16:55:18.621166 run patchelf(pid=8301): Terminated: ok {rc=0} 16:55:18.756118 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:55:19.073884 run setcap-netadm(pid=8302): Launched 16:55:20.256903 run setcap-netadm(pid=8302): Terminated: ok {rc=0} 16:55:20.588923 run srsepc(pid=8303): Launched 16:55:20.708418 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:55:21.849347 run rm-remote-dir(pid=8304): Launched 16:55:22.033493 run srsepc(pid=8303): ERR: Terminated: ERROR {rc=127} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8303)] 16:55:22.173188 run srsepc(pid=8303): stdout: | (launched: 2022-12-13_16:55:20.530692) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:55:22.311409 run srsepc(pid=8303): stderr: | (launched: 2022-12-13_16:55:20.577503) | Connection to 10.42.42.116 closed. 16:55:22.449565 run srsepc(pid=8303): stdout: | (launched: 2022-12-13_16:55:20.530692) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:55:22.582196 run srsepc(pid=8303): stderr: | (launched: 2022-12-13_16:55:20.577503) | Connection to 10.42.42.116 closed. 16:55:22.739368 run rm-remote-dir(pid=8304): Terminating (SIGINT) 16:55:22.921286 run rm-remote-dir(pid=8304): Terminated: ok {rc=0} 16:55:23.052594 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=8303): Process ended prematurely: srsepc(pid=8303) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8303)] [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 16:55:23.062927 tst iperf3_dl.py:42: Test FAILED (19.0 sec) 16:55:23.141964 run scp-back-log(pid=8305): Launched 16:55:24.221150 run scp-back-log(pid=8305): ERR: Terminated: ERROR {rc=1} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8305)] 16:55:24.282811 run scp-back-log(pid=8305): stdout: | (launched: 2022-12-13_16:55:23.109906) 16:55:24.345575 run scp-back-log(pid=8305): stderr: | (launched: 2022-12-13_16:55:23.129874) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:55:24.416155 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8305): launch_sync(): local process exited with status 1 [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8305)]') ---------------------------------------------- trial-2391 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 16:55:24.462136 tst iperf3_ul.py:13: Number of physical ue: 1 16:55:24.674494 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:55:24.717759 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 16:55:24.929467 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:55:24.945553 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:55:24.977364 tst iperf3_ul.py: using MSISDN 8241 16:55:25.093029 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8241', subscriber_id=0} 16:55:25.203805 run srsepc_10.42.42.118: Starting srsepc 16:55:25.851777 run rm-remote-dir(pid=8307): Launched 16:55:27.039514 run rm-remote-dir(pid=8307): Terminated: ok {rc=0} 16:55:27.388676 run mk-remote-dir(pid=8308): Launched 16:55:28.575117 run mk-remote-dir(pid=8308): Terminated: ok {rc=0} 16:55:28.869491 run scp-inst-to-remote(pid=8309): Launched 16:55:31.057961 run scp-inst-to-remote(pid=8309): Terminated: ok {rc=0} 16:55:31.465784 run rm-remote-dir(pid=8311): Launched 16:55:32.721331 run rm-remote-dir(pid=8311): Terminated: ok {rc=0} 16:55:33.090809 run mk-remote-dir(pid=8312): Launched 16:55:34.287373 run mk-remote-dir(pid=8312): Terminated: ok {rc=0} 16:55:34.602037 run scp-cfg-to-remote(pid=8313): Launched 16:55:35.797700 run scp-cfg-to-remote(pid=8313): Terminated: ok {rc=0} 16:55:36.112242 run scp-db-to-remote(pid=8315): Launched 16:55:37.308262 run scp-db-to-remote(pid=8315): Terminated: ok {rc=0} 16:55:37.453055 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:55:37.794090 run patchelf(pid=8317): Launched 16:55:38.989028 run patchelf(pid=8317): Terminated: ok {rc=0} 16:55:39.134918 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:55:39.475307 run setcap-netadm(pid=8318): Launched 16:55:40.670012 run setcap-netadm(pid=8318): Terminated: ok {rc=0} 16:55:41.029102 run srsepc(pid=8319): Launched 16:55:41.155126 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:55:42.370602 run rm-remote-dir(pid=8320): Launched 16:55:42.566141 run srsepc(pid=8319): ERR: Terminated: ERROR {rc=127} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8319)] 16:55:42.713597 run srsepc(pid=8319): stdout: | (launched: 2022-12-13_16:55:40.966411) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:55:42.861947 run srsepc(pid=8319): stderr: | (launched: 2022-12-13_16:55:41.016707) | Connection to 10.42.42.116 closed. 16:55:43.010754 run srsepc(pid=8319): stdout: | (launched: 2022-12-13_16:55:40.966411) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:55:43.153158 run srsepc(pid=8319): stderr: | (launched: 2022-12-13_16:55:41.016707) | Connection to 10.42.42.116 closed. 16:55:43.322513 run rm-remote-dir(pid=8320): Terminating (SIGINT) 16:55:43.516882 run rm-remote-dir(pid=8320): Terminated: ok {rc=0} 16:55:43.657990 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=8319): Process ended prematurely: srsepc(pid=8319) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8319)] [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 16:55:43.668903 tst iperf3_ul.py:42: Test FAILED (19.2 sec) 16:55:43.752363 run scp-back-log(pid=8321): Launched 16:55:44.832781 run scp-back-log(pid=8321): ERR: Terminated: ERROR {rc=1} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8321)] 16:55:44.897965 run scp-back-log(pid=8321): stdout: | (launched: 2022-12-13_16:55:43.719374) 16:55:44.964748 run scp-back-log(pid=8321): stderr: | (launched: 2022-12-13_16:55:43.740430) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:55:45.040061 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8321): launch_sync(): local process exited with status 1 [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8321)]') ---------------------------------------------- trial-2391 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 16:55:45.088774 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:55:45.106942 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:55:45.131441 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:55:45.182294 tst ping.py: using MSISDN 8242 16:55:45.307810 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8242', subscriber_id=0} 16:55:45.426417 run srsepc_10.42.42.118: Starting srsepc 16:55:46.129204 run rm-remote-dir(pid=8323): Launched 16:55:47.379799 run rm-remote-dir(pid=8323): Terminated: ok {rc=0} 16:55:47.749675 run mk-remote-dir(pid=8324): Launched 16:55:48.945040 run mk-remote-dir(pid=8324): Terminated: ok {rc=0} 16:55:49.259255 run scp-inst-to-remote(pid=8325): Launched 16:55:51.456719 run scp-inst-to-remote(pid=8325): Terminated: ok {rc=0} 16:55:51.824332 run rm-remote-dir(pid=8327): Launched 16:55:53.024191 run rm-remote-dir(pid=8327): Terminated: ok {rc=0} 16:55:53.392171 run mk-remote-dir(pid=8332): Launched 16:55:54.590286 run mk-remote-dir(pid=8332): Terminated: ok {rc=0} 16:55:54.904722 run scp-cfg-to-remote(pid=8333): Launched 16:55:56.097506 run scp-cfg-to-remote(pid=8333): Terminated: ok {rc=0} 16:55:56.409089 run scp-db-to-remote(pid=8335): Launched 16:55:57.604738 run scp-db-to-remote(pid=8335): Terminated: ok {rc=0} 16:55:57.749321 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:55:58.089565 run patchelf(pid=8337): Launched 16:55:59.282419 run patchelf(pid=8337): Terminated: ok {rc=0} 16:55:59.425915 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:55:59.765968 run setcap-netadm(pid=8338): Launched 16:56:00.959398 run setcap-netadm(pid=8338): Terminated: ok {rc=0} 16:56:01.411215 run srsepc(pid=8339): Launched 16:56:01.580704 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:56:02.913865 run rm-remote-dir(pid=8340): Launched 16:56:03.107873 run srsepc(pid=8339): ERR: Terminated: ERROR {rc=127} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8339)] 16:56:03.255033 run srsepc(pid=8339): stdout: | (launched: 2022-12-13_16:56:01.327684) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:56:03.402675 run srsepc(pid=8339): stderr: | (launched: 2022-12-13_16:56:01.392929) | Connection to 10.42.42.116 closed. 16:56:03.550422 run srsepc(pid=8339): stdout: | (launched: 2022-12-13_16:56:01.327684) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:56:03.693205 run srsepc(pid=8339): stderr: | (launched: 2022-12-13_16:56:01.392929) | Connection to 10.42.42.116 closed. 16:56:03.862438 run rm-remote-dir(pid=8340): Terminating (SIGINT) 16:56:04.057318 run rm-remote-dir(pid=8340): Terminated: ok {rc=0} 16:56:04.198205 tst ping.py:16: ERR: Error: srsepc(pid=8339): Process ended prematurely: srsepc(pid=8339) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8339)] [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 16:56:04.209176 tst ping.py:16: Test FAILED (19.1 sec) 16:56:04.292608 run scp-back-log(pid=8341): Launched 16:56:05.374997 run scp-back-log(pid=8341): ERR: Terminated: ERROR {rc=1} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8341)] 16:56:05.439917 run scp-back-log(pid=8341): stdout: | (launched: 2022-12-13_16:56:04.259348) 16:56:05.505924 run scp-back-log(pid=8341): stderr: | (launched: 2022-12-13_16:56:04.280335) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:56:05.580256 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8341): launch_sync(): local process exited with status 1 [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8341)]') ---------------------------------------------- trial-2391 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 16:56:05.628442 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:56:05.646469 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:56:05.671114 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:56:05.724793 tst rrc_idle_mo_ping.py: using MSISDN 8243 16:56:05.843177 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8243', subscriber_id=0} 16:56:05.953868 run srsepc_10.42.42.118: Starting srsepc 16:56:06.599362 run rm-remote-dir(pid=8343): Launched 16:56:07.785279 run rm-remote-dir(pid=8343): Terminated: ok {rc=0} 16:56:08.131004 run mk-remote-dir(pid=8344): Launched 16:56:09.316073 run mk-remote-dir(pid=8344): Terminated: ok {rc=0} 16:56:09.611445 run scp-inst-to-remote(pid=8345): Launched 16:56:11.801555 run scp-inst-to-remote(pid=8345): Terminated: ok {rc=0} 16:56:12.170036 run rm-remote-dir(pid=8347): Launched 16:56:13.366772 run rm-remote-dir(pid=8347): Terminated: ok {rc=0} 16:56:13.735238 run mk-remote-dir(pid=8348): Launched 16:56:14.932433 run mk-remote-dir(pid=8348): Terminated: ok {rc=0} 16:56:15.247407 run scp-cfg-to-remote(pid=8349): Launched 16:56:16.437624 run scp-cfg-to-remote(pid=8349): Terminated: ok {rc=0} 16:56:16.744635 run scp-db-to-remote(pid=8351): Launched 16:56:17.991092 run scp-db-to-remote(pid=8351): Terminated: ok {rc=0} 16:56:18.126317 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:56:18.444259 run patchelf(pid=8353): Launched 16:56:19.630673 run patchelf(pid=8353): Terminated: ok {rc=0} 16:56:19.776095 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:56:20.116743 run setcap-netadm(pid=8354): Launched 16:56:21.310538 run setcap-netadm(pid=8354): Terminated: ok {rc=0} 16:56:21.665855 run srsepc(pid=8355): Launched 16:56:21.791133 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:56:23.004804 run rm-remote-dir(pid=8356): Launched 16:56:23.199117 run srsepc(pid=8355): ERR: Terminated: ERROR {rc=127} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8355)] 16:56:23.345901 run srsepc(pid=8355): stdout: | (launched: 2022-12-13_16:56:21.603982) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:56:23.493204 run srsepc(pid=8355): stderr: | (launched: 2022-12-13_16:56:21.654101) | Connection to 10.42.42.116 closed. 16:56:23.640355 run srsepc(pid=8355): stdout: | (launched: 2022-12-13_16:56:21.603982) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:56:23.782274 run srsepc(pid=8355): stderr: | (launched: 2022-12-13_16:56:21.654101) | Connection to 10.42.42.116 closed. 16:56:23.950761 run rm-remote-dir(pid=8356): Terminating (SIGINT) 16:56:24.145761 run rm-remote-dir(pid=8356): Terminated: ok {rc=0} 16:56:24.285916 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=8355): Process ended prematurely: srsepc(pid=8355) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8355)] [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 16:56:24.296790 tst rrc_idle_mo_ping.py:16: Test FAILED (18.7 sec) 16:56:24.380116 run scp-back-log(pid=8357): Launched 16:56:25.463046 run scp-back-log(pid=8357): ERR: Terminated: ERROR {rc=1} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8357)] 16:56:25.527934 run scp-back-log(pid=8357): stdout: | (launched: 2022-12-13_16:56:24.347022) 16:56:25.593968 run scp-back-log(pid=8357): stderr: | (launched: 2022-12-13_16:56:24.367940) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:56:25.668158 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8357): launch_sync(): local process exited with status 1 [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8357)]') ---------------------------------------------- trial-2391 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 16:56:25.716508 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:56:25.734548 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:56:25.759157 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:56:25.809859 tst rrc_idle_mt_ping.py: using MSISDN 8244 16:56:25.927886 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8244', subscriber_id=0} 16:56:26.039057 run srsepc_10.42.42.118: Starting srsepc 16:56:26.687441 run rm-remote-dir(pid=8359): Launched 16:56:27.873922 run rm-remote-dir(pid=8359): Terminated: ok {rc=0} 16:56:28.221573 run mk-remote-dir(pid=8360): Launched 16:56:29.407452 run mk-remote-dir(pid=8360): Terminated: ok {rc=0} 16:56:29.703481 run scp-inst-to-remote(pid=8361): Launched 16:56:31.894764 run scp-inst-to-remote(pid=8361): Terminated: ok {rc=0} 16:56:32.337585 run rm-remote-dir(pid=8363): Launched 16:56:33.598344 run rm-remote-dir(pid=8363): Terminated: ok {rc=0} 16:56:33.966406 run mk-remote-dir(pid=8364): Launched 16:56:35.167255 run mk-remote-dir(pid=8364): Terminated: ok {rc=0} 16:56:35.483334 run scp-cfg-to-remote(pid=8365): Launched 16:56:36.678146 run scp-cfg-to-remote(pid=8365): Terminated: ok {rc=0} 16:56:36.994671 run scp-db-to-remote(pid=8367): Launched 16:56:38.188868 run scp-db-to-remote(pid=8367): Terminated: ok {rc=0} 16:56:38.333829 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:56:38.675097 run patchelf(pid=8369): Launched 16:56:39.868330 run patchelf(pid=8369): Terminated: ok {rc=0} 16:56:40.013724 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:56:40.355331 run setcap-netadm(pid=8370): Launched 16:56:41.549078 run setcap-netadm(pid=8370): Terminated: ok {rc=0} 16:56:41.907316 run srsepc(pid=8371): Launched 16:56:42.033449 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:56:43.251177 run rm-remote-dir(pid=8372): Launched 16:56:43.445874 run srsepc(pid=8371): ERR: Terminated: ERROR {rc=127} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8371)] 16:56:43.593378 run srsepc(pid=8371): stdout: | (launched: 2022-12-13_16:56:41.844231) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:56:43.741811 run srsepc(pid=8371): stderr: | (launched: 2022-12-13_16:56:41.894607) | Connection to 10.42.42.116 closed. 16:56:43.890294 run srsepc(pid=8371): stdout: | (launched: 2022-12-13_16:56:41.844231) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:56:44.033475 run srsepc(pid=8371): stderr: | (launched: 2022-12-13_16:56:41.894607) | Connection to 10.42.42.116 closed. 16:56:44.203362 run rm-remote-dir(pid=8372): Terminating (SIGINT) 16:56:44.398451 run rm-remote-dir(pid=8372): Terminated: ok {rc=0} 16:56:44.539257 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=8371): Process ended prematurely: srsepc(pid=8371) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8371)] [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 16:56:44.550155 tst rrc_idle_mt_ping.py:16: Test FAILED (18.8 sec) 16:56:44.633201 run scp-back-log(pid=8373): Launched 16:56:45.716566 run scp-back-log(pid=8373): ERR: Terminated: ERROR {rc=1} [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8373)] 16:56:45.781578 run scp-back-log(pid=8373): stdout: | (launched: 2022-12-13_16:56:44.600254) 16:56:45.849472 run scp-back-log(pid=8373): stderr: | (launched: 2022-12-13_16:56:44.621402) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:56:45.935903 tst srsepc_10.42.42.118: Error('scp-back-log(pid=8373): launch_sync(): local process exited with status 1 [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=8373)]') --------------------------------------------------------------------- trial-2391 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 16:56:46.075552 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:46.081400 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 16:56:46.126912 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 16:56:46.155395 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 16:56:46.209709 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 16:56:46.275745 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 16:56:46.311045 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 16:56:46.872861 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 16:56:46.880317 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:56:46.893095 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 16:56:46.945440 tst handover.py: using LAC 34975 16:56:47.080072 tst handover.py: using RAC 40 16:56:47.207800 tst handover.py: using CellId 34975 16:56:47.335292 tst handover.py: using BVCI 34976 16:56:47.452790 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 16:56:47.488045 tst handover.py: using LAC 34976 16:56:47.615116 tst handover.py: using RAC 41 16:56:47.737720 tst handover.py: using CellId 34976 16:56:47.860874 tst handover.py: using BVCI 34977 16:56:47.974859 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:56:47.985966 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:56:47.996671 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:56:48.007424 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:56:48.018801 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:56:48.029953 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 16:56:48.150013 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 16:56:48.271721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:48.786848 run create_hlr_db(pid=8378): Launched 16:56:49.982518 run create_hlr_db(pid=8378): Terminated: ok {rc=0} 16:56:50.335108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8380): Launched 16:56:50.668106 run osmo-hlr_10.42.42.2(pid=8381): Launched 16:56:50.798451 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:51.370723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8383): Launched 16:56:51.704859 run osmo-stp_10.42.42.5(pid=8384): Launched 16:56:51.834134 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:52.436105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8386): Launched 16:56:52.768637 run osmo-msc_10.42.42.6(pid=8387): Launched 16:56:52.956222 run osmo-stp_10.42.42.5(pid=8384): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8384)] 16:56:53.097645 run osmo-stp_10.42.42.5(pid=8384): stdout: | (launched: 2022-12-13_16:56:51.643703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:53.236766 run osmo-stp_10.42.42.5(pid=8384): stderr: | [0;m[38;5;43m20221213165651836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165651837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165651837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165651837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165651838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165651838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165651838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:53.374820 run osmo-stp_10.42.42.5(pid=8384): stdout: | (launched: 2022-12-13_16:56:51.643703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:53.506530 run osmo-stp_10.42.42.5(pid=8384): stderr: | [0;m[38;5;43m20221213165651836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165651837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165651837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165651837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165651838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165651838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165651838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:53.664301 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8384): Process ended prematurely: osmo-stp_10.42.42.5(pid=8384) [trial-2391↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8384)] [trial-2391↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 16:56:53.673553 tst handover.py:18: Test FAILED (6.8 sec) 16:56:53.701411 run osmo-hlr_10.42.42.2(pid=8381): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8381)] 16:56:53.753226 run osmo-hlr_10.42.42.2(pid=8381): stdout: | (launched: 2022-12-13_16:56:50.607276) 16:56:53.805942 run osmo-hlr_10.42.42.2(pid=8381): stderr: | [0;m[1;31m20221213165650806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165650806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165650806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165650806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165650806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165650806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165650819 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165650828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165650828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165650828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:53.879427 run osmo-msc_10.42.42.6(pid=8387): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8387)] 16:56:53.930408 run osmo-msc_10.42.42.6(pid=8387): stdout: | (launched: 2022-12-13_16:56:52.707539) 16:56:53.983024 run osmo-msc_10.42.42.6(pid=8387): stderr: | [0;m[38;5;43m20221213165653031 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165653031 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9146033c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165653031 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165653031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165653031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165653031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165653033 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165653034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165653034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165653034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:56:54.036653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8380): Terminating (SIGTERM) 16:56:54.079365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8383): Terminating (SIGTERM) 16:56:54.122390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8386): Terminating (SIGTERM) 16:56:54.165686 --- ParallelTerminationStrategy: PID 8380 died... 16:56:54.186563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8380): Terminated: ok {rc=0} 16:56:54.233817 --- ParallelTerminationStrategy: PID 8383 died... 16:56:54.254007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8383): Terminated: ok {rc=0} 16:56:54.300776 --- ParallelTerminationStrategy: PID 8386 died... 16:56:54.321050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8386): Terminated: ok {rc=0} 16:56:54.410603 bus /sierra_3: Setting Powered False 16:56:55.509189 bus /sierra_3: Setting Powered False 16:56:56.629564 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 16:56:57.878125 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:57.883777 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 16:56:57.926893 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 16:56:57.954484 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 16:56:58.007819 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 16:56:58.049283 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 16:56:58.076827 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 16:56:58.633502 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 16:56:58.639154 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:56:58.650648 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 16:56:58.691351 tst handover.py: using LAC 34977 16:56:58.823964 tst handover.py: using RAC 42 16:56:58.953837 tst handover.py: using CellId 34977 16:56:59.084121 tst handover.py: using BVCI 34978 16:56:59.204289 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 16:56:59.240055 tst handover.py: using LAC 34978 16:56:59.371830 tst handover.py: using RAC 43 16:56:59.503077 tst handover.py: using CellId 34978 16:56:59.632637 tst handover.py: using BVCI 34979 16:56:59.754703 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:56:59.766143 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:56:59.777656 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:56:59.789255 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:56:59.801088 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:56:59.812746 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 16:56:59.930001 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 16:57:00.051276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:00.538372 run create_hlr_db(pid=8392): Launched 16:57:00.673548 bus /sierra_2: Setting Powered False 16:57:01.735219 run create_hlr_db(pid=8392): Terminated: ok {rc=0} 16:57:02.157855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8394): Launched 16:57:02.486299 run osmo-hlr_10.42.42.2(pid=8395): Launched 16:57:02.609305 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:03.136259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8397): Launched 16:57:03.450415 run osmo-stp_10.42.42.5(pid=8398): Launched 16:57:03.572522 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:04.129424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8400): Launched 16:57:04.444345 run osmo-msc_10.42.42.6(pid=8401): Launched 16:57:04.620691 run osmo-stp_10.42.42.5(pid=8398): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8398)] 16:57:04.753274 run osmo-stp_10.42.42.5(pid=8398): stdout: | (launched: 2022-12-13_16:57:03.392320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:04.885081 run osmo-stp_10.42.42.5(pid=8398): stderr: | [0;m[38;5;43m20221213165703566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165703566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165703566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165703567 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165703567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165703567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165703567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:05.014667 run osmo-stp_10.42.42.5(pid=8398): stdout: | (launched: 2022-12-13_16:57:03.392320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:05.139178 run osmo-stp_10.42.42.5(pid=8398): stderr: | [0;m[38;5;43m20221213165703566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165703566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165703566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165703567 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165703567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165703567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165703567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:05.288164 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8398): Process ended prematurely: osmo-stp_10.42.42.5(pid=8398) [trial-2391↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8398)] [trial-2391↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 16:57:05.296664 tst handover.py:18: Test FAILED (6.7 sec) 16:57:05.323133 run osmo-hlr_10.42.42.2(pid=8395): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8395)] 16:57:05.371526 run osmo-hlr_10.42.42.2(pid=8395): stdout: | (launched: 2022-12-13_16:57:02.428374) 16:57:05.421654 run osmo-hlr_10.42.42.2(pid=8395): stderr: | [0;m[1;31m20221213165702605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165702605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165702605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165702605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165702605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165702605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165702619 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165702627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165702628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165702628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:05.491499 run osmo-msc_10.42.42.6(pid=8401): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8401)] 16:57:05.539421 run osmo-msc_10.42.42.6(pid=8401): stdout: | (launched: 2022-12-13_16:57:04.386499) 16:57:05.589148 run osmo-msc_10.42.42.6(pid=8401): stderr: | [0;m[38;5;43m20221213165704662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165704662 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5ee610c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165704662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165704662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165704662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165704663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165704664 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165704665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165704665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165704665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:05.639253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8394): Terminating (SIGTERM) 16:57:05.679397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8397): Terminating (SIGTERM) 16:57:05.719305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8400): Terminating (SIGTERM) 16:57:05.759637 --- ParallelTerminationStrategy: PID 8394 died... 16:57:05.778923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8394): Terminated: ok {rc=0} 16:57:05.823005 --- ParallelTerminationStrategy: PID 8397 died... 16:57:05.841591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8397): Terminated: ok {rc=0} 16:57:05.885421 --- ParallelTerminationStrategy: PID 8400 died... 16:57:05.903988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8400): Terminated: ok {rc=0} 16:57:05.988499 bus /sierra_3: Setting Powered False 16:57:07.087453 bus /sierra_3: Setting Powered False 16:57:08.208354 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 16:57:09.456051 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:09.461410 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 16:57:09.514968 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 16:57:09.541751 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 16:57:09.591550 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 16:57:09.645286 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 16:57:09.671824 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 16:57:10.225292 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 16:57:10.230605 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:10.241765 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:57:10.278098 tst handover.py: using LAC 34979 16:57:10.399203 tst handover.py: using RAC 44 16:57:10.521345 tst handover.py: using CellId 34979 16:57:10.642745 tst handover.py: using BVCI 34980 16:57:10.757984 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:57:10.804490 tst handover.py: using LAC 34980 16:57:10.924480 tst handover.py: using RAC 45 16:57:11.044766 tst handover.py: using CellId 34980 16:57:11.164767 tst handover.py: using BVCI 34981 16:57:11.277729 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:11.288753 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:11.299757 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:11.310750 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:11.321944 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:11.332893 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:57:11.456478 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:57:11.576050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:12.033084 run create_hlr_db(pid=8406): Launched 16:57:12.152637 bus /sierra_2: Setting Powered False 16:57:13.214534 run create_hlr_db(pid=8406): Terminated: ok {rc=0} 16:57:13.623242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8408): Launched 16:57:13.939356 run osmo-hlr_10.42.42.2(pid=8409): Launched 16:57:14.058788 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:14.568037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8411): Launched 16:57:14.881651 run osmo-stp_10.42.42.5(pid=8412): Launched 16:57:15.001162 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:15.537783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8414): Launched 16:57:15.850393 run osmo-msc_10.42.42.6(pid=8415): Launched 16:57:16.118521 run osmo-stp_10.42.42.5(pid=8412): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8412)] 16:57:16.297224 run osmo-stp_10.42.42.5(pid=8412): stdout: | (launched: 2022-12-13_16:57:14.823664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:16.500192 run osmo-stp_10.42.42.5(pid=8412): stderr: | [0;m[38;5;43m20221213165714997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165714997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165714997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165714998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165714998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165714998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165714998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:16.674277 run osmo-stp_10.42.42.5(pid=8412): stdout: | (launched: 2022-12-13_16:57:14.823664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:16.838535 run osmo-stp_10.42.42.5(pid=8412): stderr: | [0;m[38;5;43m20221213165714997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165714997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165714997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165714998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165714998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165714998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165714998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:17.027481 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8412): Process ended prematurely: osmo-stp_10.42.42.5(pid=8412) [trial-2391↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8412)] [trial-2391↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 16:57:17.039529 tst handover.py:18: Test FAILED (6.8 sec) 16:57:17.073449 run osmo-hlr_10.42.42.2(pid=8409): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8409)] 16:57:17.132432 run osmo-hlr_10.42.42.2(pid=8409): stdout: | (launched: 2022-12-13_16:57:13.881609) 16:57:17.187150 run osmo-hlr_10.42.42.2(pid=8409): stderr: | [0;m[1;31m20221213165714059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165714059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165714059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165714059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165714059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165714059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165714072 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165714083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165714083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165714083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:17.263185 run osmo-msc_10.42.42.6(pid=8415): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8415)] 16:57:17.316916 run osmo-msc_10.42.42.6(pid=8415): stdout: | (launched: 2022-12-13_16:57:15.792822) 16:57:17.371727 run osmo-msc_10.42.42.6(pid=8415): stderr: | [0;m[38;5;43m20221213165716371 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165716371 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe1eab22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165716371 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165716371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165716372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165716372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165716373 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165716374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165716374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165716374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:17.426918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8408): Terminating (SIGTERM) 16:57:17.470323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8411): Terminating (SIGTERM) 16:57:17.513643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8414): Terminating (SIGTERM) 16:57:17.556906 --- ParallelTerminationStrategy: PID 8408 died... 16:57:17.578214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8408): Terminated: ok {rc=0} 16:57:17.625393 --- ParallelTerminationStrategy: PID 8411 died... 16:57:17.645715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8411): Terminated: ok {rc=0} 16:57:17.692554 --- ParallelTerminationStrategy: PID 8414 died... 16:57:17.712810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8414): Terminated: ok {rc=0} 16:57:17.802536 bus /sierra_3: Setting Powered False 16:57:18.901813 bus /sierra_3: Setting Powered False 16:57:20.017632 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 16:57:21.282602 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:21.288644 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 16:57:21.340395 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:57:21.368114 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:57:21.421363 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 16:57:21.475502 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:57:21.503173 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:57:22.052297 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 16:57:22.057854 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:22.069259 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:57:22.110176 tst handover.py: using LAC 34981 16:57:22.230620 tst handover.py: using RAC 46 16:57:22.355708 tst handover.py: using CellId 34981 16:57:22.477091 tst handover.py: using BVCI 34982 16:57:22.598804 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:57:22.645250 tst handover.py: using LAC 34982 16:57:22.774649 tst handover.py: using RAC 47 16:57:22.896862 tst handover.py: using CellId 34982 16:57:23.018198 tst handover.py: using BVCI 34983 16:57:23.133496 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:23.144646 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:23.155851 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:23.167026 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:23.178473 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:23.189932 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:57:23.312120 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:57:23.433774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:23.890113 run create_hlr_db(pid=8420): Launched 16:57:24.011653 bus /sierra_2: Setting Powered False 16:57:25.072891 run create_hlr_db(pid=8420): Terminated: ok {rc=0} 16:57:25.501108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8422): Launched 16:57:25.836457 run osmo-hlr_10.42.42.2(pid=8423): Launched 16:57:25.965116 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:26.508609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8425): Launched 16:57:26.842938 run osmo-stp_10.42.42.5(pid=8426): Launched 16:57:26.971880 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:27.548701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8428): Launched 16:57:27.882682 run osmo-msc_10.42.42.6(pid=8429): Launched 16:57:28.071525 run osmo-stp_10.42.42.5(pid=8426): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8426)] 16:57:28.211288 run osmo-stp_10.42.42.5(pid=8426): stdout: | (launched: 2022-12-13_16:57:26.782018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:28.351918 run osmo-stp_10.42.42.5(pid=8426): stderr: | [0;m[38;5;43m20221213165726976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165726976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165726976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165726977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165726979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165726979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165726979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:28.490861 run osmo-stp_10.42.42.5(pid=8426): stdout: | (launched: 2022-12-13_16:57:26.782018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:28.622958 run osmo-stp_10.42.42.5(pid=8426): stderr: | [0;m[38;5;43m20221213165726976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165726976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165726976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165726977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165726979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165726979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165726979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:28.781188 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8426): Process ended prematurely: osmo-stp_10.42.42.5(pid=8426) [trial-2391↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8426)] [trial-2391↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 16:57:28.790497 tst handover.py:18: Test FAILED (6.7 sec) 16:57:28.818361 run osmo-hlr_10.42.42.2(pid=8423): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8423)] 16:57:28.868501 run osmo-hlr_10.42.42.2(pid=8423): stdout: | (launched: 2022-12-13_16:57:25.775314) 16:57:28.920319 run osmo-hlr_10.42.42.2(pid=8423): stderr: | [0;m[1;31m20221213165725977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165725977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165725977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165725977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165725977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165725977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165726042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165726052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165726052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165726052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:28.992509 run osmo-msc_10.42.42.6(pid=8429): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8429)] 16:57:29.042996 run osmo-msc_10.42.42.6(pid=8429): stdout: | (launched: 2022-12-13_16:57:27.821350) 16:57:29.094809 run osmo-msc_10.42.42.6(pid=8429): stderr: | [0;m[38;5;43m20221213165728145 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165728145 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc6e1c55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165728145 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165728145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165728145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165728145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165728147 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165728147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165728148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165728148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:29.147003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8422): Terminating (SIGTERM) 16:57:29.189062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8425): Terminating (SIGTERM) 16:57:29.231564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8428): Terminating (SIGTERM) 16:57:29.274327 --- ParallelTerminationStrategy: PID 8422 died... 16:57:29.294469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8422): Terminated: ok {rc=0} 16:57:29.341031 --- ParallelTerminationStrategy: PID 8425 died... 16:57:29.360798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8425): Terminated: ok {rc=0} 16:57:29.406958 --- ParallelTerminationStrategy: PID 8428 died... 16:57:29.426625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8428): Terminated: ok {rc=0} 16:57:29.513535 bus /sierra_3: Setting Powered False 16:57:30.613103 bus /sierra_3: Setting Powered False 16:57:31.745783 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:57:33.013912 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:33.019842 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:57:33.077144 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:57:33.106145 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:57:33.164245 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:57:33.221227 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:57:33.248810 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:57:33.799403 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:57:33.805645 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:33.817536 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:57:33.858404 tst handover.py: using LAC 34983 16:57:33.989428 tst handover.py: using RAC 48 16:57:34.120191 tst handover.py: using CellId 34983 16:57:34.250483 tst handover.py: using BVCI 34984 16:57:34.372708 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:57:34.423916 tst handover.py: using LAC 34984 16:57:34.556160 tst handover.py: using RAC 49 16:57:34.681750 tst handover.py: using CellId 34984 16:57:34.814688 tst handover.py: using BVCI 34985 16:57:34.935655 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:34.947418 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:34.959084 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:34.970876 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:34.983036 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:34.995088 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:57:35.116564 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:57:35.236685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:35.722747 run create_hlr_db(pid=8434): Launched 16:57:35.859097 bus /sierra_2: Setting Powered False 16:57:36.924088 run create_hlr_db(pid=8434): Terminated: ok {rc=0} 16:57:37.343155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8436): Launched 16:57:37.659833 run osmo-hlr_10.42.42.2(pid=8437): Launched 16:57:37.780066 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:38.294213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8439): Launched 16:57:38.607224 run osmo-stp_10.42.42.5(pid=8440): Launched 16:57:38.729438 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:39.265797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8442): Launched 16:57:39.577958 run osmo-msc_10.42.42.6(pid=8443): Launched 16:57:39.752368 run osmo-stp_10.42.42.5(pid=8440): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8440)] 16:57:39.884222 run osmo-stp_10.42.42.5(pid=8440): stdout: | (launched: 2022-12-13_16:57:38.549762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:40.015893 run osmo-stp_10.42.42.5(pid=8440): stderr: | [0;m[38;5;43m20221213165738722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165738722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165738723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165738723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165738723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165738723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165738724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:40.145487 run osmo-stp_10.42.42.5(pid=8440): stdout: | (launched: 2022-12-13_16:57:38.549762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:40.269349 run osmo-stp_10.42.42.5(pid=8440): stderr: | [0;m[38;5;43m20221213165738722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165738722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165738723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165738723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165738723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165738723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165738724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:40.417663 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8440): Process ended prematurely: osmo-stp_10.42.42.5(pid=8440) [trial-2391↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8440)] [trial-2391↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 16:57:40.426320 tst handover.py:18: Test FAILED (6.6 sec) 16:57:40.452711 run osmo-hlr_10.42.42.2(pid=8437): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8437)] 16:57:40.501457 run osmo-hlr_10.42.42.2(pid=8437): stdout: | (launched: 2022-12-13_16:57:37.602180) 16:57:40.551635 run osmo-hlr_10.42.42.2(pid=8437): stderr: | [0;m[1;31m20221213165737781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165737781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165737781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165737781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165737781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165737781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165737794 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165737805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165737805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165737805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:40.621283 run osmo-msc_10.42.42.6(pid=8443): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8443)] 16:57:40.669096 run osmo-msc_10.42.42.6(pid=8443): stdout: | (launched: 2022-12-13_16:57:39.520226) 16:57:40.718813 run osmo-msc_10.42.42.6(pid=8443): stderr: | [0;m[38;5;43m20221213165739791 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165739791 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f02bac89c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165739792 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165739792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165739792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165739792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165739794 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165739794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165739794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165739794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:40.769567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8436): Terminating (SIGTERM) 16:57:40.809734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8439): Terminating (SIGTERM) 16:57:40.849848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8442): Terminating (SIGTERM) 16:57:40.890230 --- ParallelTerminationStrategy: PID 8436 died... 16:57:40.909960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8436): Terminated: ok {rc=0} 16:57:40.954682 --- ParallelTerminationStrategy: PID 8439 died... 16:57:40.973801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8439): Terminated: ok {rc=0} 16:57:41.018365 --- ParallelTerminationStrategy: PID 8442 died... 16:57:41.037733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8442): Terminated: ok {rc=0} 16:57:41.125912 bus /sierra_3: Setting Powered False 16:57:42.229389 bus /sierra_3: Setting Powered False 16:57:43.347526 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 16:57:44.617051 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:44.622908 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:57:44.666220 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:57:44.693872 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:57:44.747329 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:57:44.791607 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:57:44.819436 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:57:45.370827 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 16:57:45.377322 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:45.389423 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 16:57:45.429740 tst handover.py: using LAC 34985 16:57:45.561687 tst handover.py: using RAC 50 16:57:45.693408 tst handover.py: using CellId 34985 16:57:45.823620 tst handover.py: using BVCI 34986 16:57:45.970649 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 16:57:46.007357 tst handover.py: using LAC 34986 16:57:46.178393 tst handover.py: using RAC 51 16:57:46.309976 tst handover.py: using CellId 34986 16:57:46.443629 tst handover.py: using BVCI 34987 16:57:46.606031 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:46.621276 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:46.636489 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:46.653420 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:46.669606 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:46.687704 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 16:57:46.841643 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 16:57:46.967683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:47.458611 run create_hlr_db(pid=8448): Launched 16:57:47.579167 bus /sierra_2: Setting Powered False 16:57:48.646080 run create_hlr_db(pid=8448): Terminated: ok {rc=0} 16:57:49.067180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8450): Launched 16:57:49.403071 run osmo-hlr_10.42.42.2(pid=8451): Launched 16:57:49.530711 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:50.076738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8453): Launched 16:57:50.409924 run osmo-stp_10.42.42.5(pid=8454): Launched 16:57:50.536873 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:51.109592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8456): Launched 16:57:51.445185 run osmo-msc_10.42.42.6(pid=8457): Launched 16:57:51.633776 run osmo-stp_10.42.42.5(pid=8454): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8454)] 16:57:51.773483 run osmo-stp_10.42.42.5(pid=8454): stdout: | (launched: 2022-12-13_16:57:50.348784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:51.913775 run osmo-stp_10.42.42.5(pid=8454): stderr: | [0;m[38;5;43m20221213165750545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165750545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165750545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165750546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165750546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165750546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165750546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:52.052534 run osmo-stp_10.42.42.5(pid=8454): stdout: | (launched: 2022-12-13_16:57:50.348784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:52.186252 run osmo-stp_10.42.42.5(pid=8454): stderr: | [0;m[38;5;43m20221213165750545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165750545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165750545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165750546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165750546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165750546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165750546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:52.344242 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8454): Process ended prematurely: osmo-stp_10.42.42.5(pid=8454) [trial-2391↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8454)] [trial-2391↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 16:57:52.353571 tst handover.py:18: Test FAILED (7.0 sec) 16:57:52.381694 run osmo-hlr_10.42.42.2(pid=8451): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8451)] 16:57:52.432446 run osmo-hlr_10.42.42.2(pid=8451): stdout: | (launched: 2022-12-13_16:57:49.341504) 16:57:52.485207 run osmo-hlr_10.42.42.2(pid=8451): stderr: | [0;m[1;31m20221213165749543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165749543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165749543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165749543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165749543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165749543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165749558 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165749566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165749566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165749566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:52.558265 run osmo-msc_10.42.42.6(pid=8457): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8457)] 16:57:52.608688 run osmo-msc_10.42.42.6(pid=8457): stdout: | (launched: 2022-12-13_16:57:51.383616) 16:57:52.661455 run osmo-msc_10.42.42.6(pid=8457): stderr: | [0;m[38;5;43m20221213165751710 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165751710 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efc020cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165751710 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165751710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165751710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165751711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165751712 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165751713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165751713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165751713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:52.714110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8450): Terminating (SIGTERM) 16:57:52.756484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8453): Terminating (SIGTERM) 16:57:52.798908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8456): Terminating (SIGTERM) 16:57:52.842043 --- ParallelTerminationStrategy: PID 8450 died... 16:57:52.862554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8450): Terminated: ok {rc=0} 16:57:52.909323 --- ParallelTerminationStrategy: PID 8453 died... 16:57:52.929096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8453): Terminated: ok {rc=0} 16:57:52.975388 --- ParallelTerminationStrategy: PID 8456 died... 16:57:52.995101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8456): Terminated: ok {rc=0} 16:57:53.083582 bus /sierra_3: Setting Powered False 16:57:54.182615 bus /sierra_3: Setting Powered False 16:57:55.300326 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 16:57:56.549436 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:56.554707 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:57:56.609748 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:57:56.636352 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:57:56.689981 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:57:56.746194 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:57:56.773970 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:57:57.320739 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 16:57:57.327718 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:57.340362 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:57:57.381286 tst handover.py: using LAC 34987 16:57:57.512474 tst handover.py: using RAC 52 16:57:57.643498 tst handover.py: using CellId 34987 16:57:57.773824 tst handover.py: using BVCI 34988 16:57:57.893756 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:57:57.949172 tst handover.py: using LAC 34988 16:57:58.078644 tst handover.py: using RAC 53 16:57:58.207046 tst handover.py: using CellId 34988 16:57:58.334707 tst handover.py: using BVCI 34989 16:57:58.454792 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:58.466293 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:58.477752 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:58.489076 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:58.500449 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:58.511748 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:57:58.631052 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:57:58.751652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:59.208691 run create_hlr_db(pid=8462): Launched 16:57:59.328553 bus /sierra_2: Setting Powered False 16:58:00.390695 run create_hlr_db(pid=8462): Terminated: ok {rc=0} 16:58:00.802692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8464): Launched 16:58:01.185793 run osmo-hlr_10.42.42.2(pid=8465): Launched 16:58:01.362418 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:02.049708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8467): Launched 16:58:02.450243 run osmo-stp_10.42.42.5(pid=8468): Launched 16:58:02.581906 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:03.156646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8470): Launched 16:58:03.492611 run osmo-msc_10.42.42.6(pid=8471): Launched 16:58:03.679346 run osmo-stp_10.42.42.5(pid=8468): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8468)] 16:58:03.820212 run osmo-stp_10.42.42.5(pid=8468): stdout: | (launched: 2022-12-13_16:58:02.389244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:03.961131 run osmo-stp_10.42.42.5(pid=8468): stderr: | [0;m[38;5;43m20221213165802582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165802582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165802582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165802583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165802583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165802583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165802583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:04.100693 run osmo-stp_10.42.42.5(pid=8468): stdout: | (launched: 2022-12-13_16:58:02.389244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:04.233154 run osmo-stp_10.42.42.5(pid=8468): stderr: | [0;m[38;5;43m20221213165802582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165802582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165802582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165802583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165802583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165802583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165802583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:04.391837 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8468): Process ended prematurely: osmo-stp_10.42.42.5(pid=8468) [trial-2391↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8468)] [trial-2391↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 16:58:04.401355 tst handover.py:18: Test FAILED (7.1 sec) 16:58:04.429192 run osmo-hlr_10.42.42.2(pid=8465): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8465)] 16:58:04.480186 run osmo-hlr_10.42.42.2(pid=8465): stdout: | (launched: 2022-12-13_16:58:01.115706) 16:58:04.533294 run osmo-hlr_10.42.42.2(pid=8465): stderr: | [0;m[1;31m20221213165801446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165801446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165801446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165801446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165801446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165801446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165801470 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165801497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165801497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165801497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:04.606862 run osmo-msc_10.42.42.6(pid=8471): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8471)] 16:58:04.657801 run osmo-msc_10.42.42.6(pid=8471): stdout: | (launched: 2022-12-13_16:58:03.431218) 16:58:04.710439 run osmo-msc_10.42.42.6(pid=8471): stderr: | [0;m[38;5;43m20221213165803754 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165803754 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcacc4d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165803755 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165803755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165803755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165803755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165803757 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165803757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165803757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165803757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:04.764087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8464): Terminating (SIGTERM) 16:58:04.806898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8467): Terminating (SIGTERM) 16:58:04.849666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8470): Terminating (SIGTERM) 16:58:04.892617 --- ParallelTerminationStrategy: PID 8464 died... 16:58:04.913142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8464): Terminated: ok {rc=0} 16:58:04.959952 --- ParallelTerminationStrategy: PID 8467 died... 16:58:04.979937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8467): Terminated: ok {rc=0} 16:58:05.026727 --- ParallelTerminationStrategy: PID 8470 died... 16:58:05.047056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8470): Terminated: ok {rc=0} 16:58:05.135756 bus /sierra_3: Setting Powered False 16:58:06.234804 bus /sierra_3: Setting Powered False 16:58:07.351213 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 16:58:08.619509 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:08.625409 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:58:08.680835 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:58:08.708608 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:58:08.763435 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:58:08.817806 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:58:08.845167 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 16:58:09.393717 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 16:58:09.399183 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:09.410390 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:58:09.449457 tst handover.py: using LAC 34989 16:58:09.575986 tst handover.py: using RAC 54 16:58:09.701608 tst handover.py: using CellId 34989 16:58:09.826243 tst handover.py: using BVCI 34990 16:58:09.941652 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:58:09.989912 tst handover.py: using LAC 34990 16:58:10.112732 tst handover.py: using RAC 55 16:58:10.237065 tst handover.py: using CellId 34990 16:58:10.360097 tst handover.py: using BVCI 34991 16:58:10.475341 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:10.486343 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:10.497724 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:10.508530 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:10.520331 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:10.532095 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:58:10.656705 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:58:10.775172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:11.235052 run create_hlr_db(pid=8476): Launched 16:58:11.356487 bus /sierra_2: Setting Powered False 16:58:12.419153 run create_hlr_db(pid=8476): Terminated: ok {rc=0} 16:58:12.830920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8478): Launched 16:58:13.146512 run osmo-hlr_10.42.42.2(pid=8479): Launched 16:58:13.266466 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:13.789112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8481): Launched 16:58:14.101586 run osmo-stp_10.42.42.5(pid=8482): Launched 16:58:14.222031 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:14.760554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8484): Launched 16:58:15.075694 run osmo-msc_10.42.42.6(pid=8485): Launched 16:58:15.251138 run osmo-stp_10.42.42.5(pid=8482): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8482)] 16:58:15.383489 run osmo-stp_10.42.42.5(pid=8482): stdout: | (launched: 2022-12-13_16:58:14.043573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:15.515696 run osmo-stp_10.42.42.5(pid=8482): stderr: | [0;m[38;5;43m20221213165814215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165814215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165814216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165814216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165814216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165814217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165814217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:15.645779 run osmo-stp_10.42.42.5(pid=8482): stdout: | (launched: 2022-12-13_16:58:14.043573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:15.769795 run osmo-stp_10.42.42.5(pid=8482): stderr: | [0;m[38;5;43m20221213165814215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165814215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165814216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165814216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165814216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165814217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165814217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:15.941295 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8482): Process ended prematurely: osmo-stp_10.42.42.5(pid=8482) [trial-2391↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8482)] [trial-2391↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 16:58:15.951092 tst handover.py:18: Test FAILED (6.5 sec) 16:58:15.979939 run osmo-hlr_10.42.42.2(pid=8479): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8479)] 16:58:16.032085 run osmo-hlr_10.42.42.2(pid=8479): stdout: | (launched: 2022-12-13_16:58:13.088656) 16:58:16.087793 run osmo-hlr_10.42.42.2(pid=8479): stderr: | [0;m[1;31m20221213165813267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165813267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165813267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165813267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165813267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165813267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165813279 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165813289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165813289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165813289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:16.163251 run osmo-msc_10.42.42.6(pid=8485): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8485)] 16:58:16.215749 run osmo-msc_10.42.42.6(pid=8485): stdout: | (launched: 2022-12-13_16:58:15.017139) 16:58:16.269513 run osmo-msc_10.42.42.6(pid=8485): stderr: | [0;m[38;5;43m20221213165815292 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165815292 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5773913c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165815292 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165815292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165815292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165815292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165815294 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165815294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165815295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165815295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:16.324570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8478): Terminating (SIGTERM) 16:58:16.371157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8481): Terminating (SIGTERM) 16:58:16.424539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8484): Terminating (SIGTERM) 16:58:16.476881 --- ParallelTerminationStrategy: PID 8478 died... 16:58:16.498514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8478): Terminated: ok {rc=0} 16:58:16.557685 --- ParallelTerminationStrategy: PID 8481 died... 16:58:16.581876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8481): Terminated: ok {rc=0} 16:58:16.640487 --- ParallelTerminationStrategy: PID 8484 died... 16:58:16.664160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8484): Terminated: ok {rc=0} 16:58:16.765937 bus /sierra_3: Setting Powered False 16:58:17.863570 bus /sierra_3: Setting Powered False 16:58:18.978646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 16:58:20.244028 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:20.250421 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 16:58:20.288543 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 16:58:20.315695 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 16:58:20.368941 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 16:58:20.406580 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 16:58:20.433712 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 16:58:20.985956 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 16:58:20.991920 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:58:21.003421 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 16:58:21.038380 tst handover.py: using LAC 34991 16:58:21.161922 tst handover.py: using RAC 56 16:58:21.284663 tst handover.py: using CellId 34991 16:58:21.407912 tst handover.py: using BVCI 34992 16:58:21.522837 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 16:58:21.556884 tst handover.py: using LAC 34992 16:58:21.680577 tst handover.py: using RAC 57 16:58:21.802766 tst handover.py: using CellId 34992 16:58:21.926470 tst handover.py: using BVCI 34993 16:58:22.039576 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:58:22.050485 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:58:22.061197 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:58:22.071825 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:58:22.083027 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:58:22.094281 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 16:58:22.215983 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 16:58:22.338045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:22.798623 run create_hlr_db(pid=8490): Launched 16:58:22.921196 bus /sierra_2: Setting Powered False 16:58:23.983400 run create_hlr_db(pid=8490): Terminated: ok {rc=0} 16:58:24.413404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8492): Launched 16:58:24.749986 run osmo-hlr_10.42.42.2(pid=8493): Launched 16:58:24.878862 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:25.425481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8495): Launched 16:58:25.761348 run osmo-stp_10.42.42.5(pid=8496): Launched 16:58:25.889409 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:26.465480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8498): Launched 16:58:26.801441 run osmo-msc_10.42.42.6(pid=8499): Launched 16:58:26.991155 run osmo-stp_10.42.42.5(pid=8496): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8496)] 16:58:27.132082 run osmo-stp_10.42.42.5(pid=8496): stdout: | (launched: 2022-12-13_16:58:25.699790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:27.273487 run osmo-stp_10.42.42.5(pid=8496): stderr: | [0;m[38;5;43m20221213165825896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165825897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165825897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165825897 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165825898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165825898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165825898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:27.412504 run osmo-stp_10.42.42.5(pid=8496): stdout: | (launched: 2022-12-13_16:58:25.699790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:27.545219 run osmo-stp_10.42.42.5(pid=8496): stderr: | [0;m[38;5;43m20221213165825896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165825897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165825897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165825897 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165825898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165825898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165825898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:27.704356 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8496): Process ended prematurely: osmo-stp_10.42.42.5(pid=8496) [trial-2391↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8496)] [trial-2391↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 16:58:27.713795 tst handover.py:18: Test FAILED (6.7 sec) 16:58:27.741650 run osmo-hlr_10.42.42.2(pid=8493): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8493)] 16:58:27.792845 run osmo-hlr_10.42.42.2(pid=8493): stdout: | (launched: 2022-12-13_16:58:24.688643) 16:58:27.845833 run osmo-hlr_10.42.42.2(pid=8493): stderr: | [0;m[1;31m20221213165824890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165824891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165824891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165824891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165824891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165824891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165824908 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165824918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165824918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165824918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:27.919834 run osmo-msc_10.42.42.6(pid=8499): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8499)] 16:58:27.970733 run osmo-msc_10.42.42.6(pid=8499): stdout: | (launched: 2022-12-13_16:58:26.739650) 16:58:28.025059 run osmo-msc_10.42.42.6(pid=8499): stderr: | [0;m[38;5;43m20221213165827063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165827063 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0fbd06c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165827063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165827063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165827064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165827064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165827066 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165827066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165827066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165827066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:28.078149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8492): Terminating (SIGTERM) 16:58:28.121271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8495): Terminating (SIGTERM) 16:58:28.163684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8498): Terminating (SIGTERM) 16:58:28.206282 --- ParallelTerminationStrategy: PID 8492 died... 16:58:28.226164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8492): Terminated: ok {rc=0} 16:58:28.273138 --- ParallelTerminationStrategy: PID 8495 died... 16:58:28.292837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8495): Terminated: ok {rc=0} 16:58:28.339423 --- ParallelTerminationStrategy: PID 8498 died... 16:58:28.359239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8498): Terminated: ok {rc=0} 16:58:28.447446 bus /sierra_3: Setting Powered False 16:58:29.547315 bus /sierra_3: Setting Powered False 16:58:30.665585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 16:58:31.915030 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:31.921250 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 16:58:31.976627 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 16:58:32.005208 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 16:58:32.059958 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 16:58:32.115180 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 16:58:32.143627 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 16:58:32.688570 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 16:58:32.694537 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:58:32.705772 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:58:32.740693 tst handover.py: using LAC 34993 16:58:32.873676 tst handover.py: using RAC 58 16:58:33.005042 tst handover.py: using CellId 34993 16:58:33.134942 tst handover.py: using BVCI 34994 16:58:33.251045 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:58:33.297840 tst handover.py: using LAC 34994 16:58:33.421332 tst handover.py: using RAC 59 16:58:33.542552 tst handover.py: using CellId 34994 16:58:33.674694 tst handover.py: using BVCI 34995 16:58:33.798061 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:58:33.809548 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:58:33.820660 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:58:33.831949 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:58:33.843598 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:58:33.854935 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:58:33.973364 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:58:34.094428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:34.583999 run create_hlr_db(pid=8504): Launched 16:58:34.719566 bus /sierra_2: Setting Powered False 16:58:35.785254 run create_hlr_db(pid=8504): Terminated: ok {rc=0} 16:58:36.207151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8506): Launched 16:58:36.522669 run osmo-hlr_10.42.42.2(pid=8507): Launched 16:58:36.646451 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:37.173711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8509): Launched 16:58:37.486838 run osmo-stp_10.42.42.5(pid=8510): Launched 16:58:37.609126 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:38.146741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8512): Launched 16:58:38.459827 run osmo-msc_10.42.42.6(pid=8513): Launched 16:58:38.637193 run osmo-stp_10.42.42.5(pid=8510): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8510)] 16:58:38.769758 run osmo-stp_10.42.42.5(pid=8510): stdout: | (launched: 2022-12-13_16:58:37.429065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:38.901900 run osmo-stp_10.42.42.5(pid=8510): stderr: | [0;m[38;5;43m20221213165837601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165837601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165837601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165837602 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165837604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165837604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165837604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:39.032653 run osmo-stp_10.42.42.5(pid=8510): stdout: | (launched: 2022-12-13_16:58:37.429065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:39.156629 run osmo-stp_10.42.42.5(pid=8510): stderr: | [0;m[38;5;43m20221213165837601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165837601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165837601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165837602 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165837604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165837604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165837604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:39.304703 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8510): Process ended prematurely: osmo-stp_10.42.42.5(pid=8510) [trial-2391↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8510)] [trial-2391↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 16:58:39.313441 tst handover.py:18: Test FAILED (6.6 sec) 16:58:39.339921 run osmo-hlr_10.42.42.2(pid=8507): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8507)] 16:58:39.388760 run osmo-hlr_10.42.42.2(pid=8507): stdout: | (launched: 2022-12-13_16:58:36.464347) 16:58:39.438666 run osmo-hlr_10.42.42.2(pid=8507): stderr: | [0;m[1;31m20221213165836644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165836644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165836644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165836644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165836644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165836644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165836656 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165836664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165836665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165836665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:39.509200 run osmo-msc_10.42.42.6(pid=8513): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8513)] 16:58:39.557084 run osmo-msc_10.42.42.6(pid=8513): stdout: | (launched: 2022-12-13_16:58:38.401982) 16:58:39.606981 run osmo-msc_10.42.42.6(pid=8513): stderr: | [0;m[38;5;43m20221213165838674 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165838674 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f91c64f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165838674 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165838674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165838675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165838675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165838676 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165838677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165838677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165838677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:39.657547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8506): Terminating (SIGTERM) 16:58:39.697763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8509): Terminating (SIGTERM) 16:58:39.738237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8512): Terminating (SIGTERM) 16:58:39.779137 --- ParallelTerminationStrategy: PID 8506 died... 16:58:39.798893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8506): Terminated: ok {rc=0} 16:58:39.843834 --- ParallelTerminationStrategy: PID 8509 died... 16:58:39.862969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8509): Terminated: ok {rc=0} 16:58:39.907399 --- ParallelTerminationStrategy: PID 8512 died... 16:58:39.926587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8512): Terminated: ok {rc=0} 16:58:40.014371 bus /sierra_3: Setting Powered False 16:58:41.114719 bus /sierra_3: Setting Powered False 16:58:42.230549 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 16:58:43.494438 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:43.500162 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 16:58:43.548557 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:58:43.576563 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:58:43.630987 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 16:58:43.678292 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:58:43.705233 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:58:44.257037 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 16:58:44.262600 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:44.273918 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:58:44.308282 tst handover.py: using LAC 34995 16:58:44.431666 tst handover.py: using RAC 60 16:58:44.555741 tst handover.py: using CellId 34995 16:58:44.679369 tst handover.py: using BVCI 34996 16:58:44.794316 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:58:44.841441 tst handover.py: using LAC 34996 16:58:44.963355 tst handover.py: using RAC 61 16:58:45.092094 tst handover.py: using CellId 34996 16:58:45.222032 tst handover.py: using BVCI 34997 16:58:45.342481 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:45.354101 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:45.365533 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:45.377005 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:45.388465 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:45.399957 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:58:45.521491 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:58:45.641724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:46.131410 run create_hlr_db(pid=8519): Launched 16:58:46.289414 bus /sierra_2: Setting Powered False 16:58:47.351237 run create_hlr_db(pid=8519): Terminated: ok {rc=0} 16:58:47.760349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8521): Launched 16:58:48.074916 run osmo-hlr_10.42.42.2(pid=8522): Launched 16:58:48.197187 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:48.708186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8524): Launched 16:58:49.022088 run osmo-stp_10.42.42.5(pid=8525): Launched 16:58:49.144371 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:49.681646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8527): Launched 16:58:49.995879 run osmo-msc_10.42.42.6(pid=8528): Launched 16:58:50.172563 run osmo-stp_10.42.42.5(pid=8525): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8525)] 16:58:50.305541 run osmo-stp_10.42.42.5(pid=8525): stdout: | (launched: 2022-12-13_16:58:48.964031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:50.437902 run osmo-stp_10.42.42.5(pid=8525): stderr: | [0;m[38;5;43m20221213165849138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165849138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165849139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165849139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165849139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165849139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165849139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:50.568025 run osmo-stp_10.42.42.5(pid=8525): stdout: | (launched: 2022-12-13_16:58:48.964031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:50.692773 run osmo-stp_10.42.42.5(pid=8525): stderr: | [0;m[38;5;43m20221213165849138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165849138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165849139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165849139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165849139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165849139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165849139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:50.841967 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8525): Process ended prematurely: osmo-stp_10.42.42.5(pid=8525) [trial-2391↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8525)] [trial-2391↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 16:58:50.850542 tst handover.py:18: Test FAILED (6.6 sec) 16:58:50.877177 run osmo-hlr_10.42.42.2(pid=8522): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8522)] 16:58:50.925935 run osmo-hlr_10.42.42.2(pid=8522): stdout: | (launched: 2022-12-13_16:58:48.016859) 16:58:50.976187 run osmo-hlr_10.42.42.2(pid=8522): stderr: | [0;m[1;31m20221213165848195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165848195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165848195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165848195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165848195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165848195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165848206 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165848215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165848215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165848215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:51.046492 run osmo-msc_10.42.42.6(pid=8528): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8528)] 16:58:51.094394 run osmo-msc_10.42.42.6(pid=8528): stdout: | (launched: 2022-12-13_16:58:49.937942) 16:58:51.144524 run osmo-msc_10.42.42.6(pid=8528): stderr: | [0;m[38;5;43m20221213165850210 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165850210 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7f88104c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165850210 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165850210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165850211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165850211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165850212 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165850213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165850213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165850213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:51.195080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8521): Terminating (SIGTERM) 16:58:51.235347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8524): Terminating (SIGTERM) 16:58:51.275688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8527): Terminating (SIGTERM) 16:58:51.316026 --- ParallelTerminationStrategy: PID 8521 died... 16:58:51.335792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8521): Terminated: ok {rc=0} 16:58:51.380293 --- ParallelTerminationStrategy: PID 8524 died... 16:58:51.399519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8524): Terminated: ok {rc=0} 16:58:51.444119 --- ParallelTerminationStrategy: PID 8527 died... 16:58:51.463372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8527): Terminated: ok {rc=0} 16:58:51.549716 bus /sierra_3: Setting Powered False 16:58:52.648721 bus /sierra_3: Setting Powered False 16:58:53.764917 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:58:55.019857 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:55.025365 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:58:55.077843 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:58:55.104555 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:58:55.160918 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:58:55.213071 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:58:55.239818 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:58:55.792084 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:58:55.797616 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:55.809255 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:58:55.844599 tst handover.py: using LAC 34997 16:58:55.969600 tst handover.py: using RAC 62 16:58:56.101416 tst handover.py: using CellId 34997 16:58:56.231966 tst handover.py: using BVCI 34998 16:58:56.354582 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:58:56.405485 tst handover.py: using LAC 34998 16:58:56.530583 tst handover.py: using RAC 63 16:58:56.654203 tst handover.py: using CellId 34998 16:58:56.776643 tst handover.py: using BVCI 34999 16:58:56.891727 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:56.903087 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:56.914184 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:56.925206 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:56.936368 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:56.947610 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:58:57.069054 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:58:57.189086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:57.648305 run create_hlr_db(pid=8533): Launched 16:58:57.768884 bus /sierra_2: Setting Powered False 16:58:58.831136 run create_hlr_db(pid=8533): Terminated: ok {rc=0} 16:58:59.241244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Launched 16:58:59.554943 run osmo-hlr_10.42.42.2(pid=8536): Launched 16:58:59.674944 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:00.201278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Launched 16:59:00.516102 run osmo-stp_10.42.42.5(pid=8539): Launched 16:59:00.637128 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:01.191462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8541): Launched 16:59:01.524481 run osmo-msc_10.42.42.6(pid=8542): Launched 16:59:01.799990 run osmo-stp_10.42.42.5(pid=8539): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] 16:59:01.983087 run osmo-stp_10.42.42.5(pid=8539): stdout: | (launched: 2022-12-13_16:59:00.458236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:02.372216 run osmo-stp_10.42.42.5(pid=8539): stderr: | [0;m[38;5;43m20221213165900631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165900631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165900631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165900632 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165900634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165900634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165900634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:02.542718 run osmo-stp_10.42.42.5(pid=8539): stdout: | (launched: 2022-12-13_16:59:00.458236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:02.675306 run osmo-stp_10.42.42.5(pid=8539): stderr: | [0;m[38;5;43m20221213165900631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165900631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165900631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165900632 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165900634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165900634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165900634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:02.833868 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8539): Process ended prematurely: osmo-stp_10.42.42.5(pid=8539) [trial-2391↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] [trial-2391↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 16:59:02.843058 tst handover.py:18: Test FAILED (7.0 sec) 16:59:02.870939 run osmo-hlr_10.42.42.2(pid=8536): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8536)] 16:59:02.921626 run osmo-hlr_10.42.42.2(pid=8536): stdout: | (launched: 2022-12-13_16:58:59.496922) 16:59:02.974180 run osmo-hlr_10.42.42.2(pid=8536): stderr: | [0;m[1;31m20221213165859678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165859678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165859678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165859678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165859678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165859678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165859690 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165859698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165859698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165859698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:03.047058 run osmo-msc_10.42.42.6(pid=8542): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8542)] 16:59:03.098209 run osmo-msc_10.42.42.6(pid=8542): stdout: | (launched: 2022-12-13_16:59:01.463940) 16:59:03.150664 run osmo-msc_10.42.42.6(pid=8542): stderr: | [0;m[38;5;43m20221213165902068 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165902068 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb920542c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165902068 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165902068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165902068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165902069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165902070 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165902072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165902072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165902072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:03.204261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Terminating (SIGTERM) 16:59:03.246730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Terminating (SIGTERM) 16:59:03.290045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8541): Terminating (SIGTERM) 16:59:03.332842 --- ParallelTerminationStrategy: PID 8535 died... 16:59:03.353183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Terminated: ok {rc=0} 16:59:03.399785 --- ParallelTerminationStrategy: PID 8538 died... 16:59:03.419613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Terminated: ok {rc=0} 16:59:03.466023 --- ParallelTerminationStrategy: PID 8541 died... 16:59:03.485780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8541): Terminated: ok {rc=0} 16:59:03.574393 bus /sierra_3: Setting Powered False 16:59:04.674255 bus /sierra_3: Setting Powered False 16:59:05.791303 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 16:59:07.055772 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:07.061421 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:59:07.101690 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:59:07.129460 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:59:07.183310 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:59:07.224214 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:59:07.252312 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:59:07.803023 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 16:59:07.808360 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:07.819697 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 16:59:07.854721 tst handover.py: using LAC 34999 16:59:07.985901 tst handover.py: using RAC 64 16:59:08.117464 tst handover.py: using CellId 34999 16:59:08.248850 tst handover.py: using BVCI 35000 16:59:08.369560 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 16:59:08.405631 tst handover.py: using LAC 35000 16:59:08.535290 tst handover.py: using RAC 65 16:59:08.666905 tst handover.py: using CellId 35000 16:59:08.798432 tst handover.py: using BVCI 35001 16:59:08.920403 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:08.931793 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:08.943042 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:08.954258 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:08.965599 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:08.977131 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 16:59:09.094170 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 16:59:09.216641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:09.703269 run create_hlr_db(pid=8547): Launched 16:59:09.838083 bus /sierra_2: Setting Powered False 16:59:10.903266 run create_hlr_db(pid=8547): Terminated: ok {rc=0} 16:59:11.339042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8549): Launched 16:59:11.672577 run osmo-hlr_10.42.42.2(pid=8550): Launched 16:59:11.801849 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:12.408753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8552): Launched 16:59:12.744199 run osmo-stp_10.42.42.5(pid=8553): Launched 16:59:12.872897 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:13.447321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8555): Launched 16:59:13.784366 run osmo-msc_10.42.42.6(pid=8556): Launched 16:59:13.971918 run osmo-stp_10.42.42.5(pid=8553): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8553)] 16:59:14.111839 run osmo-stp_10.42.42.5(pid=8553): stdout: | (launched: 2022-12-13_16:59:12.682808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:14.252307 run osmo-stp_10.42.42.5(pid=8553): stderr: | [0;m[38;5;43m20221213165912878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165912879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165912879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165912879 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165912880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165912880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165912880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:14.391211 run osmo-stp_10.42.42.5(pid=8553): stdout: | (launched: 2022-12-13_16:59:12.682808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:14.523754 run osmo-stp_10.42.42.5(pid=8553): stderr: | [0;m[38;5;43m20221213165912878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165912879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165912879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165912879 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165912880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165912880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165912880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:14.682155 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8553): Process ended prematurely: osmo-stp_10.42.42.5(pid=8553) [trial-2391↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8553)] [trial-2391↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 16:59:14.691502 tst handover.py:18: Test FAILED (6.9 sec) 16:59:14.719360 run osmo-hlr_10.42.42.2(pid=8550): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8550)] 16:59:14.770372 run osmo-hlr_10.42.42.2(pid=8550): stdout: | (launched: 2022-12-13_16:59:11.611370) 16:59:14.822899 run osmo-hlr_10.42.42.2(pid=8550): stderr: | [0;m[1;31m20221213165911812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165911812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165911812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165911813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165911813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165911813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165911825 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165911834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165911834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165911834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:14.896064 run osmo-msc_10.42.42.6(pid=8556): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8556)] 16:59:14.946570 run osmo-msc_10.42.42.6(pid=8556): stdout: | (launched: 2022-12-13_16:59:13.722314) 16:59:14.998701 run osmo-msc_10.42.42.6(pid=8556): stderr: | [0;m[38;5;43m20221213165914047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165914047 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f14ac90ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165914047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165914047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165914047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165914047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165914049 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165914049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165914050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165914050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:15.051431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8549): Terminating (SIGTERM) 16:59:15.094088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8552): Terminating (SIGTERM) 16:59:15.136926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8555): Terminating (SIGTERM) 16:59:15.179491 --- ParallelTerminationStrategy: PID 8549 died... 16:59:15.199480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8549): Terminated: ok {rc=0} 16:59:15.246199 --- ParallelTerminationStrategy: PID 8552 died... 16:59:15.266022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8552): Terminated: ok {rc=0} 16:59:15.313216 --- ParallelTerminationStrategy: PID 8555 died... 16:59:15.333109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8555): Terminated: ok {rc=0} 16:59:15.422509 bus /sierra_3: Setting Powered False 16:59:16.519962 bus /sierra_3: Setting Powered False 16:59:17.635801 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 16:59:18.876381 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:18.881677 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:59:18.933370 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:59:18.960317 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:59:19.011936 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:59:19.062800 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:59:19.089516 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:59:19.644680 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 16:59:19.650108 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:19.661054 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:59:19.695486 tst handover.py: using LAC 35001 16:59:19.827375 tst handover.py: using RAC 66 16:59:19.960186 tst handover.py: using CellId 35001 16:59:20.091197 tst handover.py: using BVCI 35002 16:59:20.212071 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:59:20.262183 tst handover.py: using LAC 35002 16:59:20.393142 tst handover.py: using RAC 67 16:59:20.523758 tst handover.py: using CellId 35002 16:59:20.656384 tst handover.py: using BVCI 35003 16:59:20.779223 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:20.790584 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:20.801807 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:20.812925 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:20.824723 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:20.836393 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:59:20.955065 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:59:21.076738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:21.563144 run create_hlr_db(pid=8561): Launched 16:59:21.700118 bus /sierra_2: Setting Powered False 16:59:22.765793 run create_hlr_db(pid=8561): Terminated: ok {rc=0} 16:59:23.185909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Launched 16:59:23.500886 run osmo-hlr_10.42.42.2(pid=8564): Launched 16:59:23.622282 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:24.137278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8566): Launched 16:59:24.450765 run osmo-stp_10.42.42.5(pid=8567): Launched 16:59:24.571755 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:25.111774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8569): Launched 16:59:25.427094 run osmo-msc_10.42.42.6(pid=8570): Launched 16:59:25.605545 run osmo-stp_10.42.42.5(pid=8567): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8567)] 16:59:25.738504 run osmo-stp_10.42.42.5(pid=8567): stdout: | (launched: 2022-12-13_16:59:24.392759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:25.871604 run osmo-stp_10.42.42.5(pid=8567): stderr: | [0;m[38;5;43m20221213165924566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165924566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165924566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165924566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165924567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165924567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165924567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:26.002151 run osmo-stp_10.42.42.5(pid=8567): stdout: | (launched: 2022-12-13_16:59:24.392759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:26.126493 run osmo-stp_10.42.42.5(pid=8567): stderr: | [0;m[38;5;43m20221213165924566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165924566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165924566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165924566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165924567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165924567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165924567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:26.275448 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8567): Process ended prematurely: osmo-stp_10.42.42.5(pid=8567) [trial-2391↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8567)] [trial-2391↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 16:59:26.284196 tst handover.py:18: Test FAILED (6.6 sec) 16:59:26.310757 run osmo-hlr_10.42.42.2(pid=8564): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8564)] 16:59:26.359919 run osmo-hlr_10.42.42.2(pid=8564): stdout: | (launched: 2022-12-13_16:59:23.443023) 16:59:26.410214 run osmo-hlr_10.42.42.2(pid=8564): stderr: | [0;m[1;31m20221213165923619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165923619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165923619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165923619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165923619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165923619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165923631 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165923640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165923640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165923640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:26.480837 run osmo-msc_10.42.42.6(pid=8570): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8570)] 16:59:26.529064 run osmo-msc_10.42.42.6(pid=8570): stdout: | (launched: 2022-12-13_16:59:25.368857) 16:59:26.579242 run osmo-msc_10.42.42.6(pid=8570): stderr: | [0;m[38;5;43m20221213165925640 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165925640 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbcd818ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165925640 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165925640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165925641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165925641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165925643 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165925643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165925643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165925643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:26.629898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Terminating (SIGTERM) 16:59:26.670529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8566): Terminating (SIGTERM) 16:59:26.711041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8569): Terminating (SIGTERM) 16:59:26.751608 --- ParallelTerminationStrategy: PID 8563 died... 16:59:26.771524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Terminated: ok {rc=0} 16:59:26.816407 --- ParallelTerminationStrategy: PID 8566 died... 16:59:26.835833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8566): Terminated: ok {rc=0} 16:59:26.880459 --- ParallelTerminationStrategy: PID 8569 died... 16:59:26.900007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8569): Terminated: ok {rc=0} 16:59:26.987444 bus /sierra_3: Setting Powered False 16:59:28.086634 bus /sierra_3: Setting Powered False 16:59:29.202791 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 16:59:30.461070 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:30.466469 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:59:30.518089 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:59:30.545007 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:59:30.595432 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:59:30.645722 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:59:30.672186 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 16:59:31.261959 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 16:59:31.271985 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:31.288107 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:59:31.331347 tst handover.py: using LAC 35003 16:59:31.456614 tst handover.py: using RAC 68 16:59:31.613869 tst handover.py: using CellId 35003 16:59:31.773531 tst handover.py: using BVCI 35004 16:59:31.920093 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:59:31.970825 tst handover.py: using LAC 35004 16:59:32.093583 tst handover.py: using RAC 69 16:59:32.217996 tst handover.py: using CellId 35004 16:59:32.340084 tst handover.py: using BVCI 35005 16:59:32.453177 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:32.464210 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:32.475189 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:32.486217 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:32.497594 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:32.508846 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:59:32.627362 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:59:32.747924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:33.236266 run create_hlr_db(pid=8576): Launched 16:59:33.373634 bus /sierra_2: Setting Powered False 16:59:34.439128 run create_hlr_db(pid=8576): Terminated: ok {rc=0} 16:59:34.859851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8578): Launched 16:59:35.174570 run osmo-hlr_10.42.42.2(pid=8579): Launched 16:59:35.295227 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:35.823274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8581): Launched 16:59:36.138628 run osmo-stp_10.42.42.5(pid=8582): Launched 16:59:36.259372 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:36.800873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8584): Launched 16:59:37.115632 run osmo-msc_10.42.42.6(pid=8585): Launched 16:59:37.292674 run osmo-stp_10.42.42.5(pid=8582): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8582)] 16:59:37.425517 run osmo-stp_10.42.42.5(pid=8582): stdout: | (launched: 2022-12-13_16:59:36.080065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:37.576221 run osmo-stp_10.42.42.5(pid=8582): stderr: | [0;m[38;5;43m20221213165936250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165936250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165936251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165936251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165936252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165936252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165936252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:37.715171 run osmo-stp_10.42.42.5(pid=8582): stdout: | (launched: 2022-12-13_16:59:36.080065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:37.848273 run osmo-stp_10.42.42.5(pid=8582): stderr: | [0;m[38;5;43m20221213165936250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165936250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165936251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165936251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165936252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165936252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165936252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:38.007529 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8582): Process ended prematurely: osmo-stp_10.42.42.5(pid=8582) [trial-2391↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8582)] [trial-2391↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 16:59:38.016887 tst handover.py:18: Test FAILED (6.7 sec) 16:59:38.044864 run osmo-hlr_10.42.42.2(pid=8579): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8579)] 16:59:38.096632 run osmo-hlr_10.42.42.2(pid=8579): stdout: | (launched: 2022-12-13_16:59:35.116582) 16:59:38.149911 run osmo-hlr_10.42.42.2(pid=8579): stderr: | [0;m[1;31m20221213165935295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165935295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165935295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165935295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165935295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165935295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165935308 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165935318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165935318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165935318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:38.223587 run osmo-msc_10.42.42.6(pid=8585): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8585)] 16:59:38.274242 run osmo-msc_10.42.42.6(pid=8585): stdout: | (launched: 2022-12-13_16:59:37.057224) 16:59:38.326890 run osmo-msc_10.42.42.6(pid=8585): stderr: | [0;m[38;5;43m20221213165937332 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165937332 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f75a3457c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165937332 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165937332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165937332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165937333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165937334 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165937335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165937335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165937335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:38.380346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8578): Terminating (SIGTERM) 16:59:38.423068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8581): Terminating (SIGTERM) 16:59:38.466074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8584): Terminating (SIGTERM) 16:59:38.508682 --- ParallelTerminationStrategy: PID 8578 died... 16:59:38.529109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8578): Terminated: ok {rc=0} 16:59:38.576271 --- ParallelTerminationStrategy: PID 8581 died... 16:59:38.596334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8581): Terminated: ok {rc=0} 16:59:38.643046 --- ParallelTerminationStrategy: PID 8584 died... 16:59:38.663096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8584): Terminated: ok {rc=0} 16:59:38.751204 bus /sierra_3: Setting Powered False 16:59:39.850149 bus /sierra_3: Setting Powered False 16:59:40.970734 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 16:59:42.225872 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:42.231022 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 16:59:42.280787 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 16:59:42.307688 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 16:59:42.359691 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 16:59:42.409766 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 16:59:42.436384 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 16:59:42.991305 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 16:59:42.996928 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:59:43.008411 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:59:43.043179 tst handover.py: using LAC 35005 16:59:43.174389 tst handover.py: using RAC 70 16:59:43.305202 tst handover.py: using CellId 35005 16:59:43.435513 tst handover.py: using BVCI 35006 16:59:43.557237 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:59:43.607517 tst handover.py: using LAC 35006 16:59:43.739716 tst handover.py: using RAC 71 16:59:43.871370 tst handover.py: using CellId 35006 16:59:44.003764 tst handover.py: using BVCI 35007 16:59:44.126794 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:59:44.138439 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:59:44.149782 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:59:44.161155 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:59:44.172730 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:59:44.184027 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:59:44.305916 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:59:44.428838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:44.915247 run create_hlr_db(pid=8590): Launched 16:59:45.052227 bus /sierra_2: Setting Powered False 16:59:46.119940 run create_hlr_db(pid=8590): Terminated: ok {rc=0} 16:59:46.584119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8592): Launched 16:59:46.939403 run osmo-hlr_10.42.42.2(pid=8593): Launched 16:59:47.142909 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:47.695701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8595): Launched 16:59:48.032505 run osmo-stp_10.42.42.5(pid=8596): Launched 16:59:48.159875 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:48.737688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8598): Launched 16:59:49.071815 run osmo-msc_10.42.42.6(pid=8599): Launched 16:59:49.259929 run osmo-stp_10.42.42.5(pid=8596): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8596)] 16:59:49.400241 run osmo-stp_10.42.42.5(pid=8596): stdout: | (launched: 2022-12-13_16:59:47.970910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:49.540797 run osmo-stp_10.42.42.5(pid=8596): stderr: | [0;m[38;5;43m20221213165948167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165948167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165948167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165948168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165948168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165948168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165948168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:49.679991 run osmo-stp_10.42.42.5(pid=8596): stdout: | (launched: 2022-12-13_16:59:47.970910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:49.812363 run osmo-stp_10.42.42.5(pid=8596): stderr: | [0;m[38;5;43m20221213165948167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165948167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165948167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165948168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165948168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165948168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165948168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:49.971084 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8596): Process ended prematurely: osmo-stp_10.42.42.5(pid=8596) [trial-2391↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8596)] [trial-2391↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 16:59:49.980047 tst handover.py:18: Test FAILED (7.0 sec) 16:59:50.007966 run osmo-hlr_10.42.42.2(pid=8593): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8593)] 16:59:50.058576 run osmo-hlr_10.42.42.2(pid=8593): stdout: | (launched: 2022-12-13_16:59:46.876812) 16:59:50.111125 run osmo-hlr_10.42.42.2(pid=8593): stderr: | [0;m[1;31m20221213165947156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165947156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165947156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165947156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165947156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165947156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165947179 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165947189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165947190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165947190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:50.184163 run osmo-msc_10.42.42.6(pid=8599): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8599)] 16:59:50.234476 run osmo-msc_10.42.42.6(pid=8599): stdout: | (launched: 2022-12-13_16:59:49.010437) 16:59:50.286758 run osmo-msc_10.42.42.6(pid=8599): stderr: | [0;m[38;5;43m20221213165949336 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213165949336 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71b4f05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213165949336 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213165949336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213165949336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213165949336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213165949338 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213165949338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213165949338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213165949339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:50.339288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8592): Terminating (SIGTERM) 16:59:50.381429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8595): Terminating (SIGTERM) 16:59:50.423756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8598): Terminating (SIGTERM) 16:59:50.466222 --- ParallelTerminationStrategy: PID 8592 died... 16:59:50.486424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8592): Terminated: ok {rc=0} 16:59:50.532879 --- ParallelTerminationStrategy: PID 8595 died... 16:59:50.553043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8595): Terminated: ok {rc=0} 16:59:50.599220 --- ParallelTerminationStrategy: PID 8598 died... 16:59:50.618953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8598): Terminated: ok {rc=0} 16:59:50.707594 bus /sierra_3: Setting Powered False 16:59:51.807044 bus /sierra_3: Setting Powered False 16:59:52.923481 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 16:59:54.184007 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:54.189904 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 16:59:54.236562 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:59:54.264243 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:59:54.319766 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 16:59:54.365400 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:59:54.391956 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:59:54.946989 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 16:59:54.953277 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:54.965136 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:59:55.003092 tst handover.py: using LAC 35007 16:59:55.133579 tst handover.py: using RAC 72 16:59:55.265838 tst handover.py: using CellId 35007 16:59:55.395918 tst handover.py: using BVCI 35008 16:59:55.516808 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:59:55.561920 tst handover.py: using LAC 35008 16:59:55.693288 tst handover.py: using RAC 73 16:59:55.822333 tst handover.py: using CellId 35008 16:59:55.952623 tst handover.py: using BVCI 35009 16:59:56.073551 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:56.085662 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:56.097240 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:56.108729 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:56.120330 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:56.131892 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:59:56.251069 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:59:56.373243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:56.861700 run create_hlr_db(pid=8605): Launched 16:59:56.997429 bus /sierra_2: Setting Powered False 16:59:58.063587 run create_hlr_db(pid=8605): Terminated: ok {rc=0} 16:59:58.485962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8607): Launched 16:59:58.801074 run osmo-hlr_10.42.42.2(pid=8608): Launched 16:59:58.921536 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:59.434824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8610): Launched 16:59:59.749564 run osmo-stp_10.42.42.5(pid=8611): Launched 16:59:59.870186 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:00.409306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8613): Launched 17:00:00.724002 run osmo-msc_10.42.42.6(pid=8614): Launched 17:00:01.034598 run osmo-stp_10.42.42.5(pid=8611): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8611)] 17:00:01.233892 run osmo-stp_10.42.42.5(pid=8611): stdout: | (launched: 2022-12-13_16:59:59.691444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:01.368298 run osmo-stp_10.42.42.5(pid=8611): stderr: | [0;m[38;5;43m20221213165959862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165959863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165959863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165959863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165959864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165959864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165959864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:01.502706 run osmo-stp_10.42.42.5(pid=8611): stdout: | (launched: 2022-12-13_16:59:59.691444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:01.630833 run osmo-stp_10.42.42.5(pid=8611): stderr: | [0;m[38;5;43m20221213165959862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213165959863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213165959863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213165959863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213165959864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213165959864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213165959864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:01.784253 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8611): Process ended prematurely: osmo-stp_10.42.42.5(pid=8611) [trial-2391↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8611)] [trial-2391↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 17:00:01.793908 tst handover.py:18: Test FAILED (6.8 sec) 17:00:01.821900 run osmo-hlr_10.42.42.2(pid=8608): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8608)] 17:00:01.875333 run osmo-hlr_10.42.42.2(pid=8608): stdout: | (launched: 2022-12-13_16:59:58.743013) 17:00:01.928693 run osmo-hlr_10.42.42.2(pid=8608): stderr: | [0;m[1;31m20221213165958922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213165958922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213165958922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213165958922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213165958922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213165958922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213165958935 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213165958946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213165958946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213165958946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:02.002060 run osmo-msc_10.42.42.6(pid=8614): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8614)] 17:00:02.052130 run osmo-msc_10.42.42.6(pid=8614): stdout: | (launched: 2022-12-13_17:00:00.666033) 17:00:02.106050 run osmo-msc_10.42.42.6(pid=8614): stderr: | [0;m[38;5;43m20221213170000959 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170000960 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9fb19a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170000960 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170000960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170000960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170000960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170000962 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170000962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170000962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170000962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:02.159711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8607): Terminating (SIGTERM) 17:00:02.202135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8610): Terminating (SIGTERM) 17:00:02.246826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8613): Terminating (SIGTERM) 17:00:02.289850 --- ParallelTerminationStrategy: PID 8607 died... 17:00:02.311007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8607): Terminated: ok {rc=0} 17:00:02.358794 --- ParallelTerminationStrategy: PID 8610 died... 17:00:02.379137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8610): Terminated: ok {rc=0} 17:00:02.424871 --- ParallelTerminationStrategy: PID 8613 died... 17:00:02.445382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8613): Terminated: ok {rc=0} 17:00:02.534295 bus /sierra_3: Setting Powered False 17:00:03.637751 bus /sierra_3: Setting Powered False 17:00:04.755986 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 17:00:06.011394 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:06.016585 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 17:00:06.067050 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:00:06.093846 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:00:06.147284 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 17:00:06.198318 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:00:06.224927 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:00:06.779767 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 17:00:06.785550 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:00:06.797299 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:00:06.832143 tst handover.py: using LAC 35009 17:00:06.962917 tst handover.py: using RAC 74 17:00:07.094833 tst handover.py: using CellId 35009 17:00:07.225379 tst handover.py: using BVCI 35010 17:00:07.346155 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:00:07.397110 tst handover.py: using LAC 35010 17:00:07.533451 tst handover.py: using RAC 75 17:00:07.663601 tst handover.py: using CellId 35010 17:00:07.796363 tst handover.py: using BVCI 35011 17:00:07.919037 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:00:07.930827 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:00:07.942459 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:00:07.953895 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:00:07.965396 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:00:07.976669 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:00:08.094674 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:00:08.217569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:08.706381 run create_hlr_db(pid=8623): Launched 17:00:08.843914 bus /sierra_2: Setting Powered False 17:00:09.908926 run create_hlr_db(pid=8623): Terminated: ok {rc=0} 17:00:10.330106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8625): Launched 17:00:10.643262 run osmo-hlr_10.42.42.2(pid=8626): Launched 17:00:10.763172 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:11.312527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8628): Launched 17:00:11.648067 run osmo-stp_10.42.42.5(pid=8629): Launched 17:00:11.779263 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:12.354417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8631): Launched 17:00:12.689535 run osmo-msc_10.42.42.6(pid=8632): Launched 17:00:12.875985 run osmo-stp_10.42.42.5(pid=8629): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8629)] 17:00:13.016904 run osmo-stp_10.42.42.5(pid=8629): stdout: | (launched: 2022-12-13_17:00:11.586858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:13.158131 run osmo-stp_10.42.42.5(pid=8629): stderr: | [0;m[38;5;43m20221213170011783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170011783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170011783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170011784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170011784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170011784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170011784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:13.296375 run osmo-stp_10.42.42.5(pid=8629): stdout: | (launched: 2022-12-13_17:00:11.586858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:13.428904 run osmo-stp_10.42.42.5(pid=8629): stderr: | [0;m[38;5;43m20221213170011783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170011783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170011783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170011784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170011784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170011784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170011784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:13.587488 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8629): Process ended prematurely: osmo-stp_10.42.42.5(pid=8629) [trial-2391↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8629)] [trial-2391↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 17:00:13.596515 tst handover.py:18: Test FAILED (6.8 sec) 17:00:13.624150 run osmo-hlr_10.42.42.2(pid=8626): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8626)] 17:00:13.674476 run osmo-hlr_10.42.42.2(pid=8626): stdout: | (launched: 2022-12-13_17:00:10.585610) 17:00:13.726640 run osmo-hlr_10.42.42.2(pid=8626): stderr: | [0;m[1;31m20221213170010762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170010762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170010762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170010762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170010762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170010762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170010775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170010783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170010783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170010784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:13.800114 run osmo-msc_10.42.42.6(pid=8632): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8632)] 17:00:13.850528 run osmo-msc_10.42.42.6(pid=8632): stdout: | (launched: 2022-12-13_17:00:12.627747) 17:00:13.902587 run osmo-msc_10.42.42.6(pid=8632): stderr: | [0;m[38;5;43m20221213170012954 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170012954 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f52fe0efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170012954 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170012954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170012954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170012954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170012956 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170012956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170012956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170012956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:13.955146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8625): Terminating (SIGTERM) 17:00:13.997299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8628): Terminating (SIGTERM) 17:00:14.040153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8631): Terminating (SIGTERM) 17:00:14.082838 --- ParallelTerminationStrategy: PID 8625 died... 17:00:14.103439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8625): Terminated: ok {rc=0} 17:00:14.150352 --- ParallelTerminationStrategy: PID 8628 died... 17:00:14.170523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8628): Terminated: ok {rc=0} 17:00:14.216916 --- ParallelTerminationStrategy: PID 8631 died... 17:00:14.236778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8631): Terminated: ok {rc=0} 17:00:14.326011 bus /sierra_3: Setting Powered False 17:00:15.424771 bus /sierra_3: Setting Powered False 17:00:16.548749 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 17:00:17.818871 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:17.823962 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 17:00:17.862046 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 17:00:17.889570 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 17:00:17.941660 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 17:00:17.980212 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 17:00:18.008223 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 17:00:18.557594 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 17:00:18.563209 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:18.574241 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 17:00:18.607430 tst handover.py: using LAC 35011 17:00:18.729373 tst handover.py: using RAC 76 17:00:18.850588 tst handover.py: using CellId 35011 17:00:18.973920 tst handover.py: using BVCI 35012 17:00:19.089937 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 17:00:19.123887 tst handover.py: using LAC 35012 17:00:19.246428 tst handover.py: using RAC 77 17:00:19.370254 tst handover.py: using CellId 35012 17:00:19.493644 tst handover.py: using BVCI 35013 17:00:19.615918 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:19.627201 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:19.638449 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:19.649610 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:19.660818 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:19.672393 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 17:00:19.793911 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 17:00:19.912184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:20.371600 run create_hlr_db(pid=8637): Launched 17:00:20.493355 bus /sierra_2: Setting Powered False 17:00:21.553845 run create_hlr_db(pid=8637): Terminated: ok {rc=0} 17:00:21.964887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8639): Launched 17:00:22.279625 run osmo-hlr_10.42.42.2(pid=8640): Launched 17:00:22.400179 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:22.909977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8642): Launched 17:00:23.224052 run osmo-stp_10.42.42.5(pid=8643): Launched 17:00:23.344446 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:23.885194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8645): Launched 17:00:24.200160 run osmo-msc_10.42.42.6(pid=8646): Launched 17:00:24.378769 run osmo-stp_10.42.42.5(pid=8643): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8643)] 17:00:24.511749 run osmo-stp_10.42.42.5(pid=8643): stdout: | (launched: 2022-12-13_17:00:23.165931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:24.644125 run osmo-stp_10.42.42.5(pid=8643): stderr: | [0;m[38;5;43m20221213170023337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170023337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170023338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170023338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170023339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170023339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170023339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:24.774698 run osmo-stp_10.42.42.5(pid=8643): stdout: | (launched: 2022-12-13_17:00:23.165931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:24.899130 run osmo-stp_10.42.42.5(pid=8643): stderr: | [0;m[38;5;43m20221213170023337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170023337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170023338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170023338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170023339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170023339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170023339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:25.048232 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8643): Process ended prematurely: osmo-stp_10.42.42.5(pid=8643) [trial-2391↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8643)] [trial-2391↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 17:00:25.056816 tst handover.py:18: Test FAILED (6.5 sec) 17:00:25.083450 run osmo-hlr_10.42.42.2(pid=8640): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8640)] 17:00:25.132551 run osmo-hlr_10.42.42.2(pid=8640): stdout: | (launched: 2022-12-13_17:00:22.221658) 17:00:25.182854 run osmo-hlr_10.42.42.2(pid=8640): stderr: | [0;m[1;31m20221213170022400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170022400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170022400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170022400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170022400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170022400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170022431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170022441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170022441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170022441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:25.254241 run osmo-msc_10.42.42.6(pid=8646): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8646)] 17:00:25.302830 run osmo-msc_10.42.42.6(pid=8646): stdout: | (launched: 2022-12-13_17:00:24.142030) 17:00:25.353221 run osmo-msc_10.42.42.6(pid=8646): stderr: | [0;m[38;5;43m20221213170024413 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170024413 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8c683fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170024413 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170024413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170024413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170024413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170024415 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170024415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170024416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170024416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:25.403866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8639): Terminating (SIGTERM) 17:00:25.444490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8642): Terminating (SIGTERM) 17:00:25.485712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8645): Terminating (SIGTERM) 17:00:25.526594 --- ParallelTerminationStrategy: PID 8639 died... 17:00:25.546514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8639): Terminated: ok {rc=0} 17:00:25.591401 --- ParallelTerminationStrategy: PID 8642 died... 17:00:25.610657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8642): Terminated: ok {rc=0} 17:00:25.655297 --- ParallelTerminationStrategy: PID 8645 died... 17:00:25.674600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8645): Terminated: ok {rc=0} 17:00:25.762526 bus /sierra_3: Setting Powered False 17:00:26.863727 bus /sierra_3: Setting Powered False 17:00:27.980130 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 17:00:29.225283 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:29.231005 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:00:29.281711 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:00:29.309567 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:00:29.364765 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:00:29.414788 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:00:29.441617 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:00:29.993829 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 17:00:29.999220 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:30.010715 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:00:30.044491 tst handover.py: using LAC 35013 17:00:30.175470 tst handover.py: using RAC 78 17:00:30.304882 tst handover.py: using CellId 35013 17:00:30.434655 tst handover.py: using BVCI 35014 17:00:30.556215 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:00:30.605858 tst handover.py: using LAC 35014 17:00:30.735892 tst handover.py: using RAC 79 17:00:30.871465 tst handover.py: using CellId 35014 17:00:31.011746 tst handover.py: using BVCI 35015 17:00:31.135622 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:31.147625 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:31.160064 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:31.172391 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:31.185170 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:31.197314 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:00:31.319544 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:00:31.443392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:31.974791 run create_hlr_db(pid=8651): Launched 17:00:32.143009 bus /sierra_2: Setting Powered False 17:00:33.208051 run create_hlr_db(pid=8651): Terminated: ok {rc=0} 17:00:33.627285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8653): Launched 17:00:33.942685 run osmo-hlr_10.42.42.2(pid=8654): Launched 17:00:34.062969 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:34.589290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8656): Launched 17:00:34.902437 run osmo-stp_10.42.42.5(pid=8657): Launched 17:00:35.022032 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:35.560199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8659): Launched 17:00:35.875685 run osmo-msc_10.42.42.6(pid=8660): Launched 17:00:36.054913 run osmo-stp_10.42.42.5(pid=8657): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8657)] 17:00:36.187655 run osmo-stp_10.42.42.5(pid=8657): stdout: | (launched: 2022-12-13_17:00:34.844441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:36.319820 run osmo-stp_10.42.42.5(pid=8657): stderr: | [0;m[38;5;43m20221213170035015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170035015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170035016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170035016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170035017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170035017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170035017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:36.449849 run osmo-stp_10.42.42.5(pid=8657): stdout: | (launched: 2022-12-13_17:00:34.844441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:36.574224 run osmo-stp_10.42.42.5(pid=8657): stderr: | [0;m[38;5;43m20221213170035015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170035015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170035016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170035016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170035017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170035017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170035017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:36.722815 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8657): Process ended prematurely: osmo-stp_10.42.42.5(pid=8657) [trial-2391↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8657)] [trial-2391↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 17:00:36.731477 tst handover.py:18: Test FAILED (6.7 sec) 17:00:36.757778 run osmo-hlr_10.42.42.2(pid=8654): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8654)] 17:00:36.806479 run osmo-hlr_10.42.42.2(pid=8654): stdout: | (launched: 2022-12-13_17:00:33.884340) 17:00:36.856348 run osmo-hlr_10.42.42.2(pid=8654): stderr: | [0;m[1;31m20221213170034061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170034061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170034061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170034061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170034061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170034061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170034073 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170034081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170034081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170034081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:36.926209 run osmo-msc_10.42.42.6(pid=8660): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8660)] 17:00:36.973705 run osmo-msc_10.42.42.6(pid=8660): stdout: | (launched: 2022-12-13_17:00:35.817166) 17:00:37.023421 run osmo-msc_10.42.42.6(pid=8660): stderr: | [0;m[38;5;43m20221213170036090 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170036090 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4204db6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170036091 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170036091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170036091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170036091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170036094 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170036094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170036094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170036094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:37.073389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8653): Terminating (SIGTERM) 17:00:37.113760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8656): Terminating (SIGTERM) 17:00:37.154052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8659): Terminating (SIGTERM) 17:00:37.194593 --- ParallelTerminationStrategy: PID 8653 died... 17:00:37.214419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8653): Terminated: ok {rc=0} 17:00:37.258852 --- ParallelTerminationStrategy: PID 8656 died... 17:00:37.277944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8656): Terminated: ok {rc=0} 17:00:37.322259 --- ParallelTerminationStrategy: PID 8659 died... 17:00:37.341487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8659): Terminated: ok {rc=0} 17:00:37.428350 bus /sierra_3: Setting Powered False 17:00:38.528243 bus /sierra_3: Setting Powered False 17:00:39.644490 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 17:00:40.898632 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:40.905741 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:00:40.956586 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:00:40.984577 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:00:41.038032 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:00:41.088186 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:00:41.116297 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:00:41.670732 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 17:00:41.676118 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:41.687540 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:41.721583 tst handover.py: using LAC 35015 17:00:41.859535 tst handover.py: using RAC 80 17:00:41.999206 tst handover.py: using CellId 35015 17:00:42.130841 tst handover.py: using BVCI 35016 17:00:42.253628 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:42.303684 tst handover.py: using LAC 35016 17:00:42.435227 tst handover.py: using RAC 81 17:00:42.565973 tst handover.py: using CellId 35016 17:00:42.695573 tst handover.py: using BVCI 35017 17:00:42.811921 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:42.822908 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:42.833807 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:42.844548 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:42.856230 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:42.867740 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:42.991269 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:43.114561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:43.571799 run create_hlr_db(pid=8665): Launched 17:00:43.692383 bus /sierra_2: Setting Powered False 17:00:44.754353 run create_hlr_db(pid=8665): Terminated: ok {rc=0} 17:00:45.164324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8667): Launched 17:00:45.479885 run osmo-hlr_10.42.42.2(pid=8668): Launched 17:00:45.601184 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:46.167490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8670): Launched 17:00:46.502951 run osmo-stp_10.42.42.5(pid=8671): Launched 17:00:46.746862 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:47.445844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8673): Launched 17:00:47.761401 run osmo-msc_10.42.42.6(pid=8674): Launched 17:00:47.937610 run osmo-stp_10.42.42.5(pid=8671): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8671)] 17:00:48.070643 run osmo-stp_10.42.42.5(pid=8671): stdout: | (launched: 2022-12-13_17:00:46.443814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:48.202945 run osmo-stp_10.42.42.5(pid=8671): stderr: | [0;m[38;5;43m20221213170046772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170046772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170046772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170046773 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170046773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170046773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170046773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:48.332925 run osmo-stp_10.42.42.5(pid=8671): stdout: | (launched: 2022-12-13_17:00:46.443814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:48.457694 run osmo-stp_10.42.42.5(pid=8671): stderr: | [0;m[38;5;43m20221213170046772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170046772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170046772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170046773 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170046773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170046773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170046773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:48.606602 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8671): Process ended prematurely: osmo-stp_10.42.42.5(pid=8671) [trial-2391↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8671)] [trial-2391↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 17:00:48.614886 tst handover.py:18: Test FAILED (6.9 sec) 17:00:48.641232 run osmo-hlr_10.42.42.2(pid=8668): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8668)] 17:00:48.689096 run osmo-hlr_10.42.42.2(pid=8668): stdout: | (launched: 2022-12-13_17:00:45.421727) 17:00:48.738809 run osmo-hlr_10.42.42.2(pid=8668): stderr: | [0;m[1;31m20221213170045600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170045600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170045600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170045600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170045600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170045600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170045612 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170045620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170045620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170045620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:48.809360 run osmo-msc_10.42.42.6(pid=8674): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8674)] 17:00:48.858022 run osmo-msc_10.42.42.6(pid=8674): stdout: | (launched: 2022-12-13_17:00:47.703384) 17:00:48.907565 run osmo-msc_10.42.42.6(pid=8674): stderr: | [0;m[38;5;43m20221213170047977 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170047977 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f87c84e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170047977 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170047977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170047978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170047978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170047979 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170047980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170047980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170047980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:48.957691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8667): Terminating (SIGTERM) 17:00:48.998103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8670): Terminating (SIGTERM) 17:00:49.038418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8673): Terminating (SIGTERM) 17:00:49.079015 --- ParallelTerminationStrategy: PID 8667 died... 17:00:49.098263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8667): Terminated: ok {rc=0} 17:00:49.142646 --- ParallelTerminationStrategy: PID 8670 died... 17:00:49.161256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8670): Terminated: ok {rc=0} 17:00:49.205717 --- ParallelTerminationStrategy: PID 8673 died... 17:00:49.224832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8673): Terminated: ok {rc=0} 17:00:49.311803 bus /sierra_3: Setting Powered False 17:00:50.412084 bus /sierra_3: Setting Powered False 17:00:51.528233 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 17:00:52.792767 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:52.799127 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 17:00:52.860257 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 17:00:52.887888 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 17:00:52.941017 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 17:00:53.001898 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 17:00:53.028698 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 17:00:53.586801 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 17:00:53.592416 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:00:53.604384 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 17:00:53.653840 tst handover.py: using LAC 35017 17:00:53.785149 tst handover.py: using RAC 82 17:00:53.913847 tst handover.py: using CellId 35017 17:00:54.036777 tst handover.py: using BVCI 35018 17:00:54.150503 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 17:00:54.193938 tst handover.py: using LAC 35018 17:00:54.317081 tst handover.py: using RAC 83 17:00:54.438282 tst handover.py: using CellId 35018 17:00:54.561369 tst handover.py: using BVCI 35019 17:00:54.674811 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:00:54.685970 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:00:54.696900 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:00:54.708313 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:00:54.719644 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:00:54.730940 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 17:00:54.852122 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 17:00:54.973460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:55.431111 run create_hlr_db(pid=8680): Launched 17:00:55.552497 bus /sierra_2: Setting Powered False 17:00:56.615127 run create_hlr_db(pid=8680): Terminated: ok {rc=0} 17:00:57.025169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8682): Launched 17:00:57.339578 run osmo-hlr_10.42.42.2(pid=8683): Launched 17:00:57.459893 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:57.968098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8685): Launched 17:00:58.282525 run osmo-stp_10.42.42.5(pid=8686): Launched 17:00:58.405119 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:58.942675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8688): Launched 17:00:59.258205 run osmo-msc_10.42.42.6(pid=8689): Launched 17:00:59.436129 run osmo-stp_10.42.42.5(pid=8686): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8686)] 17:00:59.568565 run osmo-stp_10.42.42.5(pid=8686): stdout: | (launched: 2022-12-13_17:00:58.224330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:59.700380 run osmo-stp_10.42.42.5(pid=8686): stderr: | [0;m[38;5;43m20221213170058395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170058395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170058396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170058396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170058397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170058397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170058397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:59.830165 run osmo-stp_10.42.42.5(pid=8686): stdout: | (launched: 2022-12-13_17:00:58.224330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:59.954201 run osmo-stp_10.42.42.5(pid=8686): stderr: | [0;m[38;5;43m20221213170058395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170058395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170058396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170058396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170058397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170058397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170058397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:00.102684 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8686): Process ended prematurely: osmo-stp_10.42.42.5(pid=8686) [trial-2391↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8686)] [trial-2391↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 17:01:00.111622 tst handover.py:18: Test FAILED (6.5 sec) 17:01:00.138366 run osmo-hlr_10.42.42.2(pid=8683): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8683)] 17:01:00.187361 run osmo-hlr_10.42.42.2(pid=8683): stdout: | (launched: 2022-12-13_17:00:57.281837) 17:01:00.237407 run osmo-hlr_10.42.42.2(pid=8683): stderr: | [0;m[1;31m20221213170057457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170057457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170057457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170057457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170057457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170057457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170057469 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170057477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170057477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170057477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:00.307761 run osmo-msc_10.42.42.6(pid=8689): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8689)] 17:01:00.355860 run osmo-msc_10.42.42.6(pid=8689): stdout: | (launched: 2022-12-13_17:00:59.200240) 17:01:00.406024 run osmo-msc_10.42.42.6(pid=8689): stderr: | [0;m[38;5;43m20221213170059473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170059473 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd9fb30ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170059473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170059473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170059473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170059473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170059475 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170059475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170059476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170059476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:00.456551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8682): Terminating (SIGTERM) 17:01:00.497143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8685): Terminating (SIGTERM) 17:01:00.538235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8688): Terminating (SIGTERM) 17:01:00.579074 --- ParallelTerminationStrategy: PID 8682 died... 17:01:00.598788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8682): Terminated: ok {rc=0} 17:01:00.643466 --- ParallelTerminationStrategy: PID 8685 died... 17:01:00.662669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8685): Terminated: ok {rc=0} 17:01:00.707173 --- ParallelTerminationStrategy: PID 8688 died... 17:01:00.726575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8688): Terminated: ok {rc=0} 17:01:00.810953 bus /sierra_3: Setting Powered False 17:01:01.922652 bus /sierra_3: Setting Powered False 17:01:03.056241 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 17:01:04.319400 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:01:04.324804 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 17:01:04.388756 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:01:04.416323 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:01:04.469644 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 17:01:04.536767 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:01:04.564721 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:01:05.111394 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 17:01:05.117702 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:05.129590 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:01:05.178894 tst handover.py: using LAC 35019 17:01:05.304482 tst handover.py: using RAC 84 17:01:05.437258 tst handover.py: using CellId 35019 17:01:05.567632 tst handover.py: using BVCI 35020 17:01:05.688412 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:01:05.738890 tst handover.py: using LAC 35020 17:01:05.871889 tst handover.py: using RAC 85 17:01:06.002504 tst handover.py: using CellId 35020 17:01:06.133078 tst handover.py: using BVCI 35021 17:01:06.254892 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:06.266479 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:06.277930 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:06.289555 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:06.301527 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:06.313503 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:01:06.431624 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:01:06.555663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:01:07.043102 run create_hlr_db(pid=8694): Launched 17:01:07.180367 bus /sierra_2: Setting Powered False 17:01:08.246004 run create_hlr_db(pid=8694): Terminated: ok {rc=0} 17:01:08.680019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8696): Launched 17:01:09.015495 run osmo-hlr_10.42.42.2(pid=8697): Launched 17:01:09.145153 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:09.686790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8699): Launched 17:01:10.020701 run osmo-stp_10.42.42.5(pid=8700): Launched 17:01:10.150108 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:10.721559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8702): Launched 17:01:11.057741 run osmo-msc_10.42.42.6(pid=8703): Launched 17:01:11.245610 run osmo-stp_10.42.42.5(pid=8700): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8700)] 17:01:11.384412 run osmo-stp_10.42.42.5(pid=8700): stdout: | (launched: 2022-12-13_17:01:09.959469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:11.524461 run osmo-stp_10.42.42.5(pid=8700): stderr: | [0;m[38;5;43m20221213170110154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170110154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170110154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170110155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170110155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170110155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170110155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:11.662722 run osmo-stp_10.42.42.5(pid=8700): stdout: | (launched: 2022-12-13_17:01:09.959469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:11.794907 run osmo-stp_10.42.42.5(pid=8700): stderr: | [0;m[38;5;43m20221213170110154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170110154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170110154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170110155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170110155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170110155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170110155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:11.953118 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8700): Process ended prematurely: osmo-stp_10.42.42.5(pid=8700) [trial-2391↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8700)] [trial-2391↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 17:01:11.962443 tst handover.py:18: Test FAILED (6.8 sec) 17:01:11.990462 run osmo-hlr_10.42.42.2(pid=8697): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8697)] 17:01:12.040836 run osmo-hlr_10.42.42.2(pid=8697): stdout: | (launched: 2022-12-13_17:01:08.954326) 17:01:12.092734 run osmo-hlr_10.42.42.2(pid=8697): stderr: | [0;m[1;31m20221213170109154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170109154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170109154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170109154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170109154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170109154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170109172 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170109182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170109182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170109182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:12.165589 run osmo-msc_10.42.42.6(pid=8703): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8703)] 17:01:12.216408 run osmo-msc_10.42.42.6(pid=8703): stdout: | (launched: 2022-12-13_17:01:10.995983) 17:01:12.268591 run osmo-msc_10.42.42.6(pid=8703): stderr: | [0;m[38;5;43m20221213170111321 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170111321 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbf68dedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170111321 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170111321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170111322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170111322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170111323 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170111324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170111324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170111324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:12.320863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8696): Terminating (SIGTERM) 17:01:12.363233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8699): Terminating (SIGTERM) 17:01:12.405663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8702): Terminating (SIGTERM) 17:01:12.448579 --- ParallelTerminationStrategy: PID 8696 died... 17:01:12.469382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8696): Terminated: ok {rc=0} 17:01:12.516639 --- ParallelTerminationStrategy: PID 8699 died... 17:01:12.536795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8699): Terminated: ok {rc=0} 17:01:12.583779 --- ParallelTerminationStrategy: PID 8702 died... 17:01:12.603961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8702): Terminated: ok {rc=0} 17:01:12.693173 bus /sierra_3: Setting Powered False 17:01:13.793216 bus /sierra_3: Setting Powered False 17:01:14.910640 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 17:01:16.231524 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:01:16.239226 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 17:01:16.311030 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 17:01:16.348456 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 17:01:16.413620 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 17:01:16.467177 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 17:01:16.495279 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 17:01:17.073032 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 17:01:17.079234 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:01:17.093456 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 17:01:17.148155 tst handover.py: using LAC 35021 17:01:17.273984 tst handover.py: using RAC 86 17:01:17.396919 tst handover.py: using CellId 35021 17:01:17.518642 tst handover.py: using BVCI 35022 17:01:17.634310 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 17:01:17.667578 tst handover.py: using LAC 35022 17:01:17.790087 tst handover.py: using RAC 87 17:01:17.913396 tst handover.py: using CellId 35022 17:01:18.034753 tst handover.py: using BVCI 35023 17:01:18.150484 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:01:18.161545 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:01:18.172268 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:01:18.182994 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:01:18.194675 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:01:18.206251 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 17:01:18.331956 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 17:01:18.451383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:01:18.909829 run create_hlr_db(pid=8708): Launched 17:01:19.029465 bus /sierra_2: Setting Powered False 17:01:20.091779 run create_hlr_db(pid=8708): Terminated: ok {rc=0} 17:01:20.502879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8710): Launched 17:01:20.817687 run osmo-hlr_10.42.42.2(pid=8711): Launched 17:01:20.937848 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:21.448543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8713): Launched 17:01:21.762863 run osmo-stp_10.42.42.5(pid=8714): Launched 17:01:21.896028 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:22.486375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8716): Launched 17:01:22.800412 run osmo-msc_10.42.42.6(pid=8717): Launched 17:01:22.976441 run osmo-stp_10.42.42.5(pid=8714): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8714)] 17:01:23.108745 run osmo-stp_10.42.42.5(pid=8714): stdout: | (launched: 2022-12-13_17:01:21.704801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:23.240614 run osmo-stp_10.42.42.5(pid=8714): stderr: | [0;m[38;5;43m20221213170121875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170121876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170121876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170121876 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170121877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170121877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170121877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:23.370748 run osmo-stp_10.42.42.5(pid=8714): stdout: | (launched: 2022-12-13_17:01:21.704801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:23.494616 run osmo-stp_10.42.42.5(pid=8714): stderr: | [0;m[38;5;43m20221213170121875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170121876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170121876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170121876 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170121877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170121877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170121877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:23.643082 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8714): Process ended prematurely: osmo-stp_10.42.42.5(pid=8714) [trial-2391↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8714)] [trial-2391↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 17:01:23.651667 tst handover.py:18: Test FAILED (6.6 sec) 17:01:23.678172 run osmo-hlr_10.42.42.2(pid=8711): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8711)] 17:01:23.727172 run osmo-hlr_10.42.42.2(pid=8711): stdout: | (launched: 2022-12-13_17:01:20.759800) 17:01:23.777568 run osmo-hlr_10.42.42.2(pid=8711): stderr: | [0;m[1;31m20221213170120937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170120937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170120937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170120937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170120937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170120937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170120949 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170120957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170120957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170120957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:23.848101 run osmo-msc_10.42.42.6(pid=8717): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8717)] 17:01:23.896402 run osmo-msc_10.42.42.6(pid=8717): stdout: | (launched: 2022-12-13_17:01:22.742590) 17:01:23.946604 run osmo-msc_10.42.42.6(pid=8717): stderr: | [0;m[38;5;43m20221213170123015 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170123015 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f088c7eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170123015 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170123015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170123015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170123016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170123017 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170123018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170123018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170123018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:23.997093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8710): Terminating (SIGTERM) 17:01:24.037698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8713): Terminating (SIGTERM) 17:01:24.078412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8716): Terminating (SIGTERM) 17:01:24.119388 --- ParallelTerminationStrategy: PID 8710 died... 17:01:24.139160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8710): Terminated: ok {rc=0} 17:01:24.183886 --- ParallelTerminationStrategy: PID 8713 died... 17:01:24.203177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8713): Terminated: ok {rc=0} 17:01:24.247669 --- ParallelTerminationStrategy: PID 8716 died... 17:01:24.266671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8716): Terminated: ok {rc=0} 17:01:24.353805 bus /sierra_3: Setting Powered False 17:01:25.453313 bus /sierra_3: Setting Powered False 17:01:26.569005 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 17:01:27.828930 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:01:27.834351 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:01:27.897961 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:01:27.924556 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:01:27.978981 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:01:28.044320 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:01:28.071013 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:01:28.623027 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 17:01:28.628662 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:01:28.640383 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:01:28.692751 tst handover.py: using LAC 35023 17:01:28.824931 tst handover.py: using RAC 88 17:01:28.955283 tst handover.py: using CellId 35023 17:01:29.088468 tst handover.py: using BVCI 35024 17:01:29.211932 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:01:29.261988 tst handover.py: using LAC 35024 17:01:29.392751 tst handover.py: using RAC 89 17:01:29.523662 tst handover.py: using CellId 35024 17:01:29.653431 tst handover.py: using BVCI 35025 17:01:29.776244 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:01:29.787710 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:01:29.798939 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:01:29.810266 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:01:29.822268 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:01:29.834283 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:01:29.954060 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:01:30.074988 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:01:30.566217 run create_hlr_db(pid=8722): Launched 17:01:30.704219 bus /sierra_2: Setting Powered False 17:01:31.799913 run create_hlr_db(pid=8722): Terminated: ok {rc=0} 17:01:32.264035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8724): Launched 17:01:32.581210 run osmo-hlr_10.42.42.2(pid=8725): Launched 17:01:32.701444 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:33.228415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8727): Launched 17:01:33.544007 run osmo-stp_10.42.42.5(pid=8728): Launched 17:01:33.665656 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:34.208222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8730): Launched 17:01:34.524254 run osmo-msc_10.42.42.6(pid=8731): Launched 17:01:34.700686 run osmo-stp_10.42.42.5(pid=8728): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8728)] 17:01:34.833406 run osmo-stp_10.42.42.5(pid=8728): stdout: | (launched: 2022-12-13_17:01:33.485897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:34.965942 run osmo-stp_10.42.42.5(pid=8728): stderr: | [0;m[38;5;43m20221213170133658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170133658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170133658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170133659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170133659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170133659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170133659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:35.095877 run osmo-stp_10.42.42.5(pid=8728): stdout: | (launched: 2022-12-13_17:01:33.485897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:35.220377 run osmo-stp_10.42.42.5(pid=8728): stderr: | [0;m[38;5;43m20221213170133658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170133658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170133658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170133659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170133659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170133659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170133659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:35.369454 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8728): Process ended prematurely: osmo-stp_10.42.42.5(pid=8728) [trial-2391↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8728)] [trial-2391↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 17:01:35.378045 tst handover.py:18: Test FAILED (6.7 sec) 17:01:35.404637 run osmo-hlr_10.42.42.2(pid=8725): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8725)] 17:01:35.453522 run osmo-hlr_10.42.42.2(pid=8725): stdout: | (launched: 2022-12-13_17:01:32.522932) 17:01:35.503919 run osmo-hlr_10.42.42.2(pid=8725): stderr: | [0;m[1;31m20221213170132702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170132702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170132702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170132702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170132702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170132702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170132719 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170132727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170132727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170132728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:35.574406 run osmo-msc_10.42.42.6(pid=8731): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8731)] 17:01:35.622609 run osmo-msc_10.42.42.6(pid=8731): stdout: | (launched: 2022-12-13_17:01:34.465904) 17:01:35.672909 run osmo-msc_10.42.42.6(pid=8731): stderr: | [0;m[38;5;43m20221213170134737 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170134738 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6c34942c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170134738 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170134738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170134738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170134738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170134740 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170134741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170134741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170134741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:35.723536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8724): Terminating (SIGTERM) 17:01:35.764273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8727): Terminating (SIGTERM) 17:01:35.804885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8730): Terminating (SIGTERM) 17:01:35.846232 --- ParallelTerminationStrategy: PID 8724 died... 17:01:35.866154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8724): Terminated: ok {rc=0} 17:01:35.910964 --- ParallelTerminationStrategy: PID 8727 died... 17:01:35.930195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8727): Terminated: ok {rc=0} 17:01:35.974792 --- ParallelTerminationStrategy: PID 8730 died... 17:01:35.993989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8730): Terminated: ok {rc=0} 17:01:36.078938 bus /sierra_3: Setting Powered False 17:01:37.178209 bus /sierra_3: Setting Powered False 17:01:38.294918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 17:01:39.572308 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:01:39.578821 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:01:39.642962 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:01:39.669737 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:01:39.723552 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:01:39.787421 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:01:39.814583 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:01:40.369373 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 17:01:40.375621 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:40.387547 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:01:40.438808 tst handover.py: using LAC 35025 17:01:40.569099 tst handover.py: using RAC 90 17:01:40.697233 tst handover.py: using CellId 35025 17:01:40.819212 tst handover.py: using BVCI 35026 17:01:40.935038 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:01:40.981495 tst handover.py: using LAC 35026 17:01:41.105321 tst handover.py: using RAC 91 17:01:41.235654 tst handover.py: using CellId 35026 17:01:41.364652 tst handover.py: using BVCI 35027 17:01:41.485794 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:41.497227 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:41.508845 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:41.520175 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:41.531495 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:41.542725 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:01:41.664709 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:01:41.783574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:01:42.243191 run create_hlr_db(pid=8736): Launched 17:01:42.366180 bus /sierra_2: Setting Powered False 17:01:43.427806 run create_hlr_db(pid=8736): Terminated: ok {rc=0} 17:01:43.838783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8738): Launched 17:01:44.155253 run osmo-hlr_10.42.42.2(pid=8739): Launched 17:01:44.277353 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:44.787042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8741): Launched 17:01:45.101080 run osmo-stp_10.42.42.5(pid=8742): Launched 17:01:45.221776 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:45.762836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8744): Launched 17:01:46.099092 run osmo-msc_10.42.42.6(pid=8745): Launched 17:01:46.764555 run osmo-stp_10.42.42.5(pid=8742): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8742)] 17:01:47.079220 run osmo-stp_10.42.42.5(pid=8742): stdout: | (launched: 2022-12-13_17:01:45.042890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:47.215007 run osmo-stp_10.42.42.5(pid=8742): stderr: | [0;m[38;5;43m20221213170145216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170145216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170145216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170145217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170145217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170145217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170145217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:47.347539 run osmo-stp_10.42.42.5(pid=8742): stdout: | (launched: 2022-12-13_17:01:45.042890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:47.471702 run osmo-stp_10.42.42.5(pid=8742): stderr: | [0;m[38;5;43m20221213170145216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170145216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170145216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170145217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170145217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170145217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170145217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:47.620611 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8742): Process ended prematurely: osmo-stp_10.42.42.5(pid=8742) [trial-2391↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8742)] [trial-2391↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 17:01:47.629254 tst handover.py:18: Test FAILED (7.2 sec) 17:01:47.655915 run osmo-hlr_10.42.42.2(pid=8739): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8739)] 17:01:47.705121 run osmo-hlr_10.42.42.2(pid=8739): stdout: | (launched: 2022-12-13_17:01:44.097091) 17:01:47.755393 run osmo-hlr_10.42.42.2(pid=8739): stderr: | [0;m[1;31m20221213170144273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170144273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170144273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170144273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170144273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170144274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170144286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170144294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170144294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170144294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:47.825966 run osmo-msc_10.42.42.6(pid=8745): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8745)] 17:01:47.874400 run osmo-msc_10.42.42.6(pid=8745): stdout: | (launched: 2022-12-13_17:01:46.039426) 17:01:47.925009 run osmo-msc_10.42.42.6(pid=8745): stderr: | [0;m[38;5;43m20221213170146700 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170146700 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f72e2857c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170146700 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170146700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170146700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170146703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170146707 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170146708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170146708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170146711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:47.975900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8738): Terminating (SIGTERM) 17:01:48.016681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8741): Terminating (SIGTERM) 17:01:48.057312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8744): Terminating (SIGTERM) 17:01:48.098463 --- ParallelTerminationStrategy: PID 8738 died... 17:01:48.118392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8738): Terminated: ok {rc=0} 17:01:48.163365 --- ParallelTerminationStrategy: PID 8741 died... 17:01:48.182769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8741): Terminated: ok {rc=0} 17:01:48.227884 --- ParallelTerminationStrategy: PID 8744 died... 17:01:48.247436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8744): Terminated: ok {rc=0} 17:01:48.335633 bus /sierra_3: Setting Powered False 17:01:49.436207 bus /sierra_3: Setting Powered False 17:01:50.550010 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 17:01:51.827346 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:01:51.833178 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 17:01:51.894928 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:01:51.922661 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:01:51.976147 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 17:01:52.038826 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:01:52.066509 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:01:52.623250 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 17:01:52.629041 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:52.641068 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:01:52.687271 tst handover.py: using LAC 35027 17:01:52.818201 tst handover.py: using RAC 92 17:01:52.949231 tst handover.py: using CellId 35027 17:01:53.079552 tst handover.py: using BVCI 35028 17:01:53.203103 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:01:53.253994 tst handover.py: using LAC 35028 17:01:53.383830 tst handover.py: using RAC 93 17:01:53.508702 tst handover.py: using CellId 35028 17:01:53.633378 tst handover.py: using BVCI 35029 17:01:53.747451 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:53.758810 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:53.770330 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:53.781629 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:53.793534 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:01:53.805030 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:01:53.927570 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:01:54.045101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:01:54.505092 run create_hlr_db(pid=8750): Launched 17:01:54.626102 bus /sierra_2: Setting Powered False 17:01:55.688400 run create_hlr_db(pid=8750): Terminated: ok {rc=0} 17:01:56.117756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8752): Launched 17:01:56.453268 run osmo-hlr_10.42.42.2(pid=8753): Launched 17:01:56.584124 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:57.133812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8755): Launched 17:01:57.470033 run osmo-stp_10.42.42.5(pid=8756): Launched 17:01:57.601306 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:58.181451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8758): Launched 17:01:58.518765 run osmo-msc_10.42.42.6(pid=8759): Launched 17:01:58.708006 run osmo-stp_10.42.42.5(pid=8756): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8756)] 17:01:58.848931 run osmo-stp_10.42.42.5(pid=8756): stdout: | (launched: 2022-12-13_17:01:57.408269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:58.989867 run osmo-stp_10.42.42.5(pid=8756): stderr: | [0;m[38;5;43m20221213170157604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170157604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170157605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170157605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170157606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170157606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170157606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:59.129279 run osmo-stp_10.42.42.5(pid=8756): stdout: | (launched: 2022-12-13_17:01:57.408269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:59.262464 run osmo-stp_10.42.42.5(pid=8756): stderr: | [0;m[38;5;43m20221213170157604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170157604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170157605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170157605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170157606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170157606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170157606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:59.421759 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8756): Process ended prematurely: osmo-stp_10.42.42.5(pid=8756) [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8756)] [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 17:01:59.430675 tst handover.py:18: Test FAILED (6.8 sec) 17:01:59.459053 run osmo-hlr_10.42.42.2(pid=8753): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8753)] 17:01:59.510116 run osmo-hlr_10.42.42.2(pid=8753): stdout: | (launched: 2022-12-13_17:01:56.391481) 17:01:59.562823 run osmo-hlr_10.42.42.2(pid=8753): stderr: | [0;m[1;31m20221213170156592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170156592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170156592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170156592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170156592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170156592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170156605 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170156614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170156614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170156614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:59.636457 run osmo-msc_10.42.42.6(pid=8759): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8759)] 17:01:59.687269 run osmo-msc_10.42.42.6(pid=8759): stdout: | (launched: 2022-12-13_17:01:58.456801) 17:01:59.740050 run osmo-msc_10.42.42.6(pid=8759): stderr: | [0;m[38;5;43m20221213170158782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170158782 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcee2a75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170158782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170158782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170158782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170158782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170158784 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170158785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170158785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170158785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:59.793238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8752): Terminating (SIGTERM) 17:01:59.836005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8755): Terminating (SIGTERM) 17:01:59.878797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8758): Terminating (SIGTERM) 17:01:59.921634 --- ParallelTerminationStrategy: PID 8752 died... 17:01:59.942116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8752): Terminated: ok {rc=0} 17:01:59.989168 --- ParallelTerminationStrategy: PID 8755 died... 17:02:00.008879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8755): Terminated: ok {rc=0} 17:02:00.055121 --- ParallelTerminationStrategy: PID 8758 died... 17:02:00.074925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8758): Terminated: ok {rc=0} 17:02:00.163214 bus /sierra_3: Setting Powered False 17:02:01.259781 bus /sierra_3: Setting Powered False 17:02:02.380251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 17:02:03.650451 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:02:03.656624 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 17:02:03.706367 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 17:02:03.733848 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 17:02:03.790377 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 17:02:03.839844 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 17:02:03.867432 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 17:02:04.414990 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 17:02:04.420493 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:04.431751 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 17:02:04.476148 tst handover.py: using LAC 35029 17:02:04.599986 tst handover.py: using RAC 94 17:02:04.724438 tst handover.py: using CellId 35029 17:02:04.848395 tst handover.py: using BVCI 35030 17:02:04.963484 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 17:02:04.998455 tst handover.py: using LAC 35030 17:02:05.120863 tst handover.py: using RAC 95 17:02:05.243296 tst handover.py: using CellId 35030 17:02:05.366977 tst handover.py: using BVCI 35031 17:02:05.482011 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:05.493109 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:05.503954 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:05.514893 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:05.526245 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:05.537671 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 17:02:05.661067 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 17:02:05.780093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:02:06.238533 run create_hlr_db(pid=8764): Launched 17:02:06.359649 bus /sierra_2: Setting Powered False 17:02:07.421420 run create_hlr_db(pid=8764): Terminated: ok {rc=0} 17:02:07.849273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8766): Launched 17:02:08.186536 run osmo-hlr_10.42.42.2(pid=8767): Launched 17:02:08.314466 run osmo-stp_10.42.42.5: Starting osmo-stp 17:02:08.868703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8769): Launched 17:02:09.205490 run osmo-stp_10.42.42.5(pid=8770): Launched 17:02:09.334377 run osmo-msc_10.42.42.6: Starting osmo-msc 17:02:09.907049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8772): Launched 17:02:10.242364 run osmo-msc_10.42.42.6(pid=8773): Launched 17:02:10.429073 run osmo-stp_10.42.42.5(pid=8770): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8770)] 17:02:10.569316 run osmo-stp_10.42.42.5(pid=8770): stdout: | (launched: 2022-12-13_17:02:09.143377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:10.710187 run osmo-stp_10.42.42.5(pid=8770): stderr: | [0;m[38;5;43m20221213170209337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170209337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170209337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170209338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170209338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170209338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170209338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:10.848330 run osmo-stp_10.42.42.5(pid=8770): stdout: | (launched: 2022-12-13_17:02:09.143377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:10.980015 run osmo-stp_10.42.42.5(pid=8770): stderr: | [0;m[38;5;43m20221213170209337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170209337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170209337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170209338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170209338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170209338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170209338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:11.138031 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8770): Process ended prematurely: osmo-stp_10.42.42.5(pid=8770) [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8770)] [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 17:02:11.146938 tst handover.py:18: Test FAILED (6.7 sec) 17:02:11.175164 run osmo-hlr_10.42.42.2(pid=8767): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8767)] 17:02:11.225429 run osmo-hlr_10.42.42.2(pid=8767): stdout: | (launched: 2022-12-13_17:02:08.124424) 17:02:11.277614 run osmo-hlr_10.42.42.2(pid=8767): stderr: | [0;m[1;31m20221213170208325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170208325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170208325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170208325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170208325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170208325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170208337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170208346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170208346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170208346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:02:11.350106 run osmo-msc_10.42.42.6(pid=8773): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8773)] 17:02:11.400026 run osmo-msc_10.42.42.6(pid=8773): stdout: | (launched: 2022-12-13_17:02:10.180614) 17:02:11.451927 run osmo-msc_10.42.42.6(pid=8773): stderr: | [0;m[38;5;43m20221213170210506 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170210506 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6a596f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170210506 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170210506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170210506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170210506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170210508 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170210508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170210508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170210508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:02:11.504087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8766): Terminating (SIGTERM) 17:02:11.546187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8769): Terminating (SIGTERM) 17:02:11.588215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8772): Terminating (SIGTERM) 17:02:11.630432 --- ParallelTerminationStrategy: PID 8766 died... 17:02:11.650178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8766): Terminated: ok {rc=0} 17:02:11.696210 --- ParallelTerminationStrategy: PID 8769 died... 17:02:11.715720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8769): Terminated: ok {rc=0} 17:02:11.761690 --- ParallelTerminationStrategy: PID 8772 died... 17:02:11.781296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8772): Terminated: ok {rc=0} 17:02:11.869616 bus /sierra_3: Setting Powered False 17:02:12.968386 bus /sierra_3: Setting Powered False 17:02:14.086764 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 17:02:15.343577 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:02:15.349071 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:02:15.408540 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:02:15.435544 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:02:15.487566 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:02:15.547715 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:02:15.574941 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:02:16.187821 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 17:02:16.197430 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:16.213704 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:02:16.274122 tst handover.py: using LAC 35031 17:02:16.408896 tst handover.py: using RAC 96 17:02:16.553583 tst handover.py: using CellId 35031 17:02:16.686933 tst handover.py: using BVCI 35032 17:02:16.843659 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:02:16.893181 tst handover.py: using LAC 35032 17:02:17.023955 tst handover.py: using RAC 97 17:02:17.155579 tst handover.py: using CellId 35032 17:02:17.286685 tst handover.py: using BVCI 35033 17:02:17.407781 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:17.419433 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:17.430910 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:17.442494 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:17.454177 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:17.465656 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:02:17.586171 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:02:17.705966 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:02:18.165261 run create_hlr_db(pid=8778): Launched 17:02:18.287366 bus /sierra_2: Setting Powered False 17:02:19.349188 run create_hlr_db(pid=8778): Terminated: ok {rc=0} 17:02:19.777098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8780): Launched 17:02:20.114096 run osmo-hlr_10.42.42.2(pid=8781): Launched 17:02:20.243044 run osmo-stp_10.42.42.5: Starting osmo-stp 17:02:20.792811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8783): Launched 17:02:21.127648 run osmo-stp_10.42.42.5(pid=8784): Launched 17:02:21.257909 run osmo-msc_10.42.42.6: Starting osmo-msc 17:02:21.831188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8786): Launched 17:02:22.168073 run osmo-msc_10.42.42.6(pid=8787): Launched 17:02:22.357594 run osmo-stp_10.42.42.5(pid=8784): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8784)] 17:02:22.498026 run osmo-stp_10.42.42.5(pid=8784): stdout: | (launched: 2022-12-13_17:02:21.066291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:22.639004 run osmo-stp_10.42.42.5(pid=8784): stderr: | [0;m[38;5;43m20221213170221260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170221260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170221260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170221260 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170221261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170221261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170221261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:22.778802 run osmo-stp_10.42.42.5(pid=8784): stdout: | (launched: 2022-12-13_17:02:21.066291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:22.911853 run osmo-stp_10.42.42.5(pid=8784): stderr: | [0;m[38;5;43m20221213170221260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170221260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170221260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170221260 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170221261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170221261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170221261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:23.070808 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8784): Process ended prematurely: osmo-stp_10.42.42.5(pid=8784) [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8784)] [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 17:02:23.080138 tst handover.py:18: Test FAILED (6.9 sec) 17:02:23.108278 run osmo-hlr_10.42.42.2(pid=8781): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8781)] 17:02:23.158592 run osmo-hlr_10.42.42.2(pid=8781): stdout: | (launched: 2022-12-13_17:02:20.052332) 17:02:23.211320 run osmo-hlr_10.42.42.2(pid=8781): stderr: | [0;m[1;31m20221213170220253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170220253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170220253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170220253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170220254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170220254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170220266 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170220275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170220275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170220275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:02:23.284207 run osmo-msc_10.42.42.6(pid=8787): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8787)] 17:02:23.334472 run osmo-msc_10.42.42.6(pid=8787): stdout: | (launched: 2022-12-13_17:02:22.106534) 17:02:23.386438 run osmo-msc_10.42.42.6(pid=8787): stderr: | [0;m[38;5;43m20221213170222429 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170222430 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8bbb110c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170222430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170222430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170222430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170222430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170222432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170222432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170222432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170222432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:02:23.438720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8780): Terminating (SIGTERM) 17:02:23.480478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8783): Terminating (SIGTERM) 17:02:23.522527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8786): Terminating (SIGTERM) 17:02:23.565197 --- ParallelTerminationStrategy: PID 8780 died... 17:02:23.585349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8780): Terminated: ok {rc=0} 17:02:23.631336 --- ParallelTerminationStrategy: PID 8783 died... 17:02:23.651169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8783): Terminated: ok {rc=0} 17:02:23.697789 --- ParallelTerminationStrategy: PID 8786 died... 17:02:23.717648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8786): Terminated: ok {rc=0} 17:02:23.806524 bus /sierra_3: Setting Powered False 17:02:24.905371 bus /sierra_3: Setting Powered False 17:02:26.024325 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 17:02:27.304295 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:02:27.310217 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:02:27.370141 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:02:27.397783 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:02:27.451495 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:02:27.511665 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:02:27.539364 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:02:28.094008 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 17:02:28.101609 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:02:28.113603 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:02:28.157192 tst handover.py: using LAC 35033 17:02:28.279494 tst handover.py: using RAC 98 17:02:28.410919 tst handover.py: using CellId 35033 17:02:28.543111 tst handover.py: using BVCI 35034 17:02:28.666244 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:02:28.714740 tst handover.py: using LAC 35034 17:02:28.847520 tst handover.py: using RAC 99 17:02:28.979501 tst handover.py: using CellId 35034 17:02:29.109090 tst handover.py: using BVCI 35035 17:02:29.230529 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:02:29.242171 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:02:29.253642 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:02:29.265284 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:02:29.276734 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:02:29.288226 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:02:29.407250 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:02:29.529291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:02:30.018603 run create_hlr_db(pid=8792): Launched 17:02:30.156078 bus /sierra_2: Setting Powered False 17:02:31.256468 run create_hlr_db(pid=8792): Terminated: ok {rc=0} 17:02:31.728400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8794): Launched 17:02:32.067835 run osmo-hlr_10.42.42.2(pid=8795): Launched 17:02:32.257391 run osmo-stp_10.42.42.5: Starting osmo-stp 17:02:32.784461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8797): Launched 17:02:33.099334 run osmo-stp_10.42.42.5(pid=8798): Launched 17:02:33.221239 run osmo-msc_10.42.42.6: Starting osmo-msc 17:02:33.759803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8800): Launched 17:02:34.075015 run osmo-msc_10.42.42.6(pid=8801): Launched 17:02:34.253403 run osmo-stp_10.42.42.5(pid=8798): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8798)] 17:02:34.386117 run osmo-stp_10.42.42.5(pid=8798): stdout: | (launched: 2022-12-13_17:02:33.041144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:34.518684 run osmo-stp_10.42.42.5(pid=8798): stderr: | [0;m[38;5;43m20221213170233214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170233214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170233215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170233215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170233215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170233216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170233216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:34.649316 run osmo-stp_10.42.42.5(pid=8798): stdout: | (launched: 2022-12-13_17:02:33.041144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:34.773789 run osmo-stp_10.42.42.5(pid=8798): stderr: | [0;m[38;5;43m20221213170233214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170233214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170233215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170233215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170233215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170233216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170233216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:34.923423 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8798): Process ended prematurely: osmo-stp_10.42.42.5(pid=8798) [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8798)] [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 17:02:34.932079 tst handover.py:18: Test FAILED (6.8 sec) 17:02:34.958650 run osmo-hlr_10.42.42.2(pid=8795): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8795)] 17:02:35.007473 run osmo-hlr_10.42.42.2(pid=8795): stdout: | (launched: 2022-12-13_17:02:32.008360) 17:02:35.058304 run osmo-hlr_10.42.42.2(pid=8795): stderr: | [0;m[1;31m20221213170232269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170232269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170232269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170232269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170232269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170232269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170232286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170232296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170232296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170232296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:02:35.134794 run osmo-msc_10.42.42.6(pid=8801): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8801)] 17:02:35.187830 run osmo-msc_10.42.42.6(pid=8801): stdout: | (launched: 2022-12-13_17:02:34.016699) 17:02:35.238979 run osmo-msc_10.42.42.6(pid=8801): stderr: | [0;m[38;5;43m20221213170234289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170234289 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff89f9f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170234289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170234289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170234290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170234290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170234291 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170234292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170234292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170234292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:02:35.291079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8794): Terminating (SIGTERM) 17:02:35.332908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8797): Terminating (SIGTERM) 17:02:35.374889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8800): Terminating (SIGTERM) 17:02:35.417536 --- ParallelTerminationStrategy: PID 8794 died... 17:02:35.436921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8794): Terminated: ok {rc=0} 17:02:35.482296 --- ParallelTerminationStrategy: PID 8797 died... 17:02:35.502009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8797): Terminated: ok {rc=0} 17:02:35.547518 --- ParallelTerminationStrategy: PID 8800 died... 17:02:35.566436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8800): Terminated: ok {rc=0} 17:02:35.653914 bus /sierra_3: Setting Powered False 17:02:36.755721 bus /sierra_3: Setting Powered False 17:02:37.874434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 17:02:39.150546 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:02:39.156304 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 17:02:39.209738 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 17:02:39.236517 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 17:02:39.291528 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 17:02:39.345600 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 17:02:39.373494 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 17:02:39.922173 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 17:02:39.928482 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:39.940436 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 17:02:39.989613 tst handover.py: using LAC 35035 17:02:40.122694 tst handover.py: using RAC 100 17:02:40.255449 tst handover.py: using CellId 35035 17:02:40.387277 tst handover.py: using BVCI 35036 17:02:40.518956 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 17:02:40.553976 tst handover.py: using LAC 35036 17:02:40.687261 tst handover.py: using RAC 101 17:02:40.818785 tst handover.py: using CellId 35036 17:02:40.948660 tst handover.py: using BVCI 35037 17:02:41.071527 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:41.083050 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:41.094593 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:41.106082 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:41.118034 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:02:41.129911 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 17:02:41.249631 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 17:02:41.370583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:02:41.860126 run create_hlr_db(pid=8806): Launched 17:02:41.997721 bus /sierra_2: Setting Powered False 17:02:43.064164 run create_hlr_db(pid=8806): Terminated: ok {rc=0} 17:02:43.484860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8808): Launched 17:02:43.801653 run osmo-hlr_10.42.42.2(pid=8809): Launched 17:02:43.922616 run osmo-stp_10.42.42.5: Starting osmo-stp 17:02:44.451011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8811): Launched 17:02:44.767086 run osmo-stp_10.42.42.5(pid=8812): Launched 17:02:44.889677 run osmo-msc_10.42.42.6: Starting osmo-msc 17:02:45.431085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8814): Launched 17:02:45.749176 run osmo-msc_10.42.42.6(pid=8815): Launched 17:02:46.003651 run osmo-stp_10.42.42.5(pid=8812): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8812)] 17:02:46.350933 run osmo-stp_10.42.42.5(pid=8812): stdout: | (launched: 2022-12-13_17:02:44.708201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:46.676255 run osmo-stp_10.42.42.5(pid=8812): stderr: | [0;m[38;5;43m20221213170244881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170244881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170244881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170244882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170244882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170244882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170244882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:46.828153 run osmo-stp_10.42.42.5(pid=8812): stdout: | (launched: 2022-12-13_17:02:44.708201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:46.965610 run osmo-stp_10.42.42.5(pid=8812): stderr: | [0;m[38;5;43m20221213170244881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170244881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170244881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170244882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170244882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170244882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170244882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:47.129480 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8812): Process ended prematurely: osmo-stp_10.42.42.5(pid=8812) [trial-2391↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8812)] [trial-2391↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 17:02:47.138675 tst handover.py:18: Test FAILED (7.2 sec) 17:02:47.166933 run osmo-hlr_10.42.42.2(pid=8809): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8809)] 17:02:47.220425 run osmo-hlr_10.42.42.2(pid=8809): stdout: | (launched: 2022-12-13_17:02:43.743338) 17:02:47.273531 run osmo-hlr_10.42.42.2(pid=8809): stderr: | [0;m[1;31m20221213170243924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170243924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170243924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170243924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170243924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170243924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170243936 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170243945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170243945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170243945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:02:47.347163 run osmo-msc_10.42.42.6(pid=8815): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8815)] 17:02:47.397634 run osmo-msc_10.42.42.6(pid=8815): stdout: | (launched: 2022-12-13_17:02:45.690416) 17:02:47.448663 run osmo-msc_10.42.42.6(pid=8815): stderr: | [0;m[38;5;43m20221213170246155 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170246157 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa1aa40fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170246157 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170246158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170246159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170246160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170246163 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170246164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170246165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170246165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:02:47.500141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8808): Terminating (SIGTERM) 17:02:47.541893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8811): Terminating (SIGTERM) 17:02:47.583462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8814): Terminating (SIGTERM) 17:02:47.625429 --- ParallelTerminationStrategy: PID 8808 died... 17:02:47.645839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8808): Terminated: ok {rc=0} 17:02:47.691532 --- ParallelTerminationStrategy: PID 8811 died... 17:02:47.712032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8811): Terminated: ok {rc=0} 17:02:47.757980 --- ParallelTerminationStrategy: PID 8814 died... 17:02:47.778235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8814): Terminated: ok {rc=0} 17:02:47.867648 bus /sierra_3: Setting Powered False 17:02:48.968553 bus /sierra_3: Setting Powered False 17:02:50.085115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 17:02:51.345906 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:02:51.352307 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:02:51.418031 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:02:51.445817 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:02:51.503308 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:02:51.572558 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:02:51.600241 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:02:52.143091 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 17:02:52.148760 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:52.160065 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:02:52.210554 tst handover.py: using LAC 35037 17:02:52.343805 tst handover.py: using RAC 102 17:02:52.468734 tst handover.py: using CellId 35037 17:02:52.592417 tst handover.py: using BVCI 35038 17:02:52.705854 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:02:52.754343 tst handover.py: using LAC 35038 17:02:52.877178 tst handover.py: using RAC 103 17:02:53.003871 tst handover.py: using CellId 35038 17:02:53.125361 tst handover.py: using BVCI 35039 17:02:53.238440 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:53.249560 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:53.260402 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:53.271419 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:53.282702 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:02:53.293877 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:02:53.415421 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:02:53.534512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:02:53.993276 run create_hlr_db(pid=8820): Launched 17:02:54.112772 bus /sierra_2: Setting Powered False 17:02:55.174891 run create_hlr_db(pid=8820): Terminated: ok {rc=0} 17:02:55.585171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8822): Launched 17:02:55.900806 run osmo-hlr_10.42.42.2(pid=8823): Launched 17:02:56.022653 run osmo-stp_10.42.42.5: Starting osmo-stp 17:02:56.547558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8825): Launched 17:02:56.863973 run osmo-stp_10.42.42.5(pid=8826): Launched 17:02:56.985157 run osmo-msc_10.42.42.6: Starting osmo-msc 17:02:57.526852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8828): Launched 17:02:57.843994 run osmo-msc_10.42.42.6(pid=8829): Launched 17:02:58.020573 run osmo-stp_10.42.42.5(pid=8826): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8826)] 17:02:58.153749 run osmo-stp_10.42.42.5(pid=8826): stdout: | (launched: 2022-12-13_17:02:56.805814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:58.286331 run osmo-stp_10.42.42.5(pid=8826): stderr: | [0;m[38;5;43m20221213170256979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170256979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170256979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170256979 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170256980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170256980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170256980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:58.416794 run osmo-stp_10.42.42.5(pid=8826): stdout: | (launched: 2022-12-13_17:02:56.805814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:58.541388 run osmo-stp_10.42.42.5(pid=8826): stderr: | [0;m[38;5;43m20221213170256979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170256979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170256979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170256979 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170256980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170256980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170256980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:58.690631 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8826): Process ended prematurely: osmo-stp_10.42.42.5(pid=8826) [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8826)] [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 17:02:58.698916 tst handover.py:18: Test FAILED (6.5 sec) 17:02:58.725521 run osmo-hlr_10.42.42.2(pid=8823): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8823)] 17:02:58.774964 run osmo-hlr_10.42.42.2(pid=8823): stdout: | (launched: 2022-12-13_17:02:55.841689) 17:02:58.825522 run osmo-hlr_10.42.42.2(pid=8823): stderr: | [0;m[1;31m20221213170256021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170256021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170256021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170256021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170256021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170256021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170256036 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170256046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170256046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170256047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:02:58.896249 run osmo-msc_10.42.42.6(pid=8829): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8829)] 17:02:58.944436 run osmo-msc_10.42.42.6(pid=8829): stdout: | (launched: 2022-12-13_17:02:57.785544) 17:02:58.994894 run osmo-msc_10.42.42.6(pid=8829): stderr: | [0;m[38;5;43m20221213170258061 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170258061 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0537ee1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170258061 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170258061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170258061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170258062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170258063 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170258064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170258064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170258064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:02:59.045504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8822): Terminating (SIGTERM) 17:02:59.086519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8825): Terminating (SIGTERM) 17:02:59.127163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8828): Terminating (SIGTERM) 17:02:59.167847 --- ParallelTerminationStrategy: PID 8822 died... 17:02:59.187488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8822): Terminated: ok {rc=0} 17:02:59.232230 --- ParallelTerminationStrategy: PID 8825 died... 17:02:59.251258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8825): Terminated: ok {rc=0} 17:02:59.296257 --- ParallelTerminationStrategy: PID 8828 died... 17:02:59.315430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8828): Terminated: ok {rc=0} 17:02:59.403404 bus /sierra_3: Setting Powered False 17:03:00.504473 bus /sierra_3: Setting Powered False 17:03:01.620857 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 17:03:02.908692 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:03:02.914767 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:03:02.979941 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:03:03.007960 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:03:03.062532 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:03:03.129417 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:03:03.157129 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:03:03.709296 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 17:03:03.714637 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:03.726225 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:03:03.776857 tst handover.py: using LAC 35039 17:03:03.902286 tst handover.py: using RAC 104 17:03:04.032666 tst handover.py: using CellId 35039 17:03:04.155646 tst handover.py: using BVCI 35040 17:03:04.280739 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:03:04.329565 tst handover.py: using LAC 35040 17:03:04.454244 tst handover.py: using RAC 105 17:03:04.579009 tst handover.py: using CellId 35040 17:03:04.702150 tst handover.py: using BVCI 35041 17:03:04.825718 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:04.837556 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:04.849292 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:04.861088 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:04.873404 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:04.885663 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:03:05.005235 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:03:05.127216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:03:05.619485 run create_hlr_db(pid=8835): Launched 17:03:05.755569 bus /sierra_2: Setting Powered False 17:03:06.821652 run create_hlr_db(pid=8835): Terminated: ok {rc=0} 17:03:07.243552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8837): Launched 17:03:07.559714 run osmo-hlr_10.42.42.2(pid=8838): Launched 17:03:07.682069 run osmo-stp_10.42.42.5: Starting osmo-stp 17:03:08.209755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8840): Launched 17:03:08.527867 run osmo-stp_10.42.42.5(pid=8841): Launched 17:03:08.649729 run osmo-msc_10.42.42.6: Starting osmo-msc 17:03:09.193327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8843): Launched 17:03:09.509307 run osmo-msc_10.42.42.6(pid=8844): Launched 17:03:09.687434 run osmo-stp_10.42.42.5(pid=8841): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8841)] 17:03:09.828190 run osmo-stp_10.42.42.5(pid=8841): stdout: | (launched: 2022-12-13_17:03:08.469259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:09.984655 run osmo-stp_10.42.42.5(pid=8841): stderr: | [0;m[38;5;43m20221213170308641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170308642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170308642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170308642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170308643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170308643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170308643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:10.123780 run osmo-stp_10.42.42.5(pid=8841): stdout: | (launched: 2022-12-13_17:03:08.469259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:10.257969 run osmo-stp_10.42.42.5(pid=8841): stderr: | [0;m[38;5;43m20221213170308641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170308642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170308642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170308642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170308643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170308643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170308643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:10.417993 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8841): Process ended prematurely: osmo-stp_10.42.42.5(pid=8841) [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8841)] [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 17:03:10.427169 tst handover.py:18: Test FAILED (6.7 sec) 17:03:10.455443 run osmo-hlr_10.42.42.2(pid=8838): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8838)] 17:03:10.506696 run osmo-hlr_10.42.42.2(pid=8838): stdout: | (launched: 2022-12-13_17:03:07.501417) 17:03:10.559768 run osmo-hlr_10.42.42.2(pid=8838): stderr: | [0;m[1;31m20221213170307678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170307678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170307678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170307678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170307678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170307678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170307690 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170307698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170307700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170307700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:03:10.633419 run osmo-msc_10.42.42.6(pid=8844): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8844)] 17:03:10.684505 run osmo-msc_10.42.42.6(pid=8844): stdout: | (launched: 2022-12-13_17:03:09.450849) 17:03:10.737124 run osmo-msc_10.42.42.6(pid=8844): stderr: | [0;m[38;5;43m20221213170309727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170309727 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd67a93dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170309727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170309727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170309727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170309727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170309729 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170309730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170309730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170309730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:03:10.790021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8837): Terminating (SIGTERM) 17:03:10.832466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8840): Terminating (SIGTERM) 17:03:10.875901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8843): Terminating (SIGTERM) 17:03:10.919280 --- ParallelTerminationStrategy: PID 8837 died... 17:03:10.939967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8837): Terminated: ok {rc=0} 17:03:10.987187 --- ParallelTerminationStrategy: PID 8840 died... 17:03:11.007321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8840): Terminated: ok {rc=0} 17:03:11.054249 --- ParallelTerminationStrategy: PID 8843 died... 17:03:11.074289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8843): Terminated: ok {rc=0} 17:03:11.164136 bus /sierra_3: Setting Powered False 17:03:12.265782 bus /sierra_3: Setting Powered False 17:03:13.384130 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 17:03:14.655297 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:03:14.662114 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:03:14.715919 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:03:14.744442 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:03:14.797056 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:03:14.849522 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:03:14.877197 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:03:15.429490 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 17:03:15.435040 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:03:15.446363 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:03:15.481520 tst handover.py: using LAC 35041 17:03:15.613051 tst handover.py: using RAC 106 17:03:15.737249 tst handover.py: using CellId 35041 17:03:15.863817 tst handover.py: using BVCI 35042 17:03:16.005529 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:03:16.055865 tst handover.py: using LAC 35042 17:03:16.181907 tst handover.py: using RAC 107 17:03:16.345024 tst handover.py: using CellId 35042 17:03:16.481735 tst handover.py: using BVCI 35043 17:03:16.599485 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:03:16.611111 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:03:16.622588 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:03:16.634080 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:03:16.646611 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:03:16.659040 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:03:16.779910 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:03:16.898785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:03:17.433169 run create_hlr_db(pid=8849): Launched 17:03:17.554295 bus /sierra_2: Setting Powered False 17:03:18.616600 run create_hlr_db(pid=8849): Terminated: ok {rc=0} 17:03:19.047043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8851): Launched 17:03:19.385513 run osmo-hlr_10.42.42.2(pid=8852): Launched 17:03:19.515816 run osmo-stp_10.42.42.5: Starting osmo-stp 17:03:20.068570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8854): Launched 17:03:20.407161 run osmo-stp_10.42.42.5(pid=8855): Launched 17:03:20.537768 run osmo-msc_10.42.42.6: Starting osmo-msc 17:03:21.114566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8857): Launched 17:03:21.450970 run osmo-msc_10.42.42.6(pid=8858): Launched 17:03:21.641314 run osmo-stp_10.42.42.5(pid=8855): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8855)] 17:03:21.780693 run osmo-stp_10.42.42.5(pid=8855): stdout: | (launched: 2022-12-13_17:03:20.345464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:21.921135 run osmo-stp_10.42.42.5(pid=8855): stderr: | [0;m[38;5;43m20221213170320540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170320540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170320540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170320541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170320541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170320541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170320541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:22.059969 run osmo-stp_10.42.42.5(pid=8855): stdout: | (launched: 2022-12-13_17:03:20.345464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:22.192479 run osmo-stp_10.42.42.5(pid=8855): stderr: | [0;m[38;5;43m20221213170320540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170320540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170320540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170320541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170320541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170320541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170320541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:22.351215 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8855): Process ended prematurely: osmo-stp_10.42.42.5(pid=8855) [trial-2391↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8855)] [trial-2391↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 17:03:22.360360 tst handover.py:18: Test FAILED (6.9 sec) 17:03:22.388254 run osmo-hlr_10.42.42.2(pid=8852): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8852)] 17:03:22.438817 run osmo-hlr_10.42.42.2(pid=8852): stdout: | (launched: 2022-12-13_17:03:19.323486) 17:03:22.490825 run osmo-hlr_10.42.42.2(pid=8852): stderr: | [0;m[1;31m20221213170319524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170319524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170319524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170319525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170319525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170319525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170319537 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170319546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170319546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170319546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:03:22.563706 run osmo-msc_10.42.42.6(pid=8858): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8858)] 17:03:22.613903 run osmo-msc_10.42.42.6(pid=8858): stdout: | (launched: 2022-12-13_17:03:21.389261) 17:03:22.666160 run osmo-msc_10.42.42.6(pid=8858): stderr: | [0;m[38;5;43m20221213170321716 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170321716 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fab14efbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170321717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170321717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170321717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170321717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170321719 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170321719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170321719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170321719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:03:22.718404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8851): Terminating (SIGTERM) 17:03:22.760442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8854): Terminating (SIGTERM) 17:03:22.802948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8857): Terminating (SIGTERM) 17:03:22.845743 --- ParallelTerminationStrategy: PID 8851 died... 17:03:22.865951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8851): Terminated: ok {rc=0} 17:03:22.912256 --- ParallelTerminationStrategy: PID 8854 died... 17:03:22.931924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8854): Terminated: ok {rc=0} 17:03:22.978083 --- ParallelTerminationStrategy: PID 8857 died... 17:03:22.997755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8857): Terminated: ok {rc=0} 17:03:23.085595 bus /sierra_3: Setting Powered False 17:03:24.185063 bus /sierra_3: Setting Powered False 17:03:25.301383 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 17:03:26.564085 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:03:26.570267 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:03:26.622517 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:03:26.650152 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:03:26.703627 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:03:26.755903 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:03:26.783490 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:03:27.333129 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 17:03:27.338691 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:27.350127 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:03:27.384052 tst handover.py: using LAC 35043 17:03:27.506797 tst handover.py: using RAC 108 17:03:27.629185 tst handover.py: using CellId 35043 17:03:27.751355 tst handover.py: using BVCI 35044 17:03:27.866586 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:03:27.914727 tst handover.py: using LAC 35044 17:03:28.046039 tst handover.py: using RAC 109 17:03:28.179973 tst handover.py: using CellId 35044 17:03:28.311818 tst handover.py: using BVCI 35045 17:03:28.433379 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:28.445073 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:28.456224 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:28.467519 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:28.478910 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:28.490136 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:03:28.612633 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:03:28.732629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:03:29.191811 run create_hlr_db(pid=8863): Launched 17:03:29.313924 bus /sierra_2: Setting Powered False 17:03:30.376323 run create_hlr_db(pid=8863): Terminated: ok {rc=0} 17:03:30.805755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8865): Launched 17:03:31.185308 run osmo-hlr_10.42.42.2(pid=8866): Launched 17:03:31.391621 run osmo-stp_10.42.42.5: Starting osmo-stp 17:03:32.119592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8868): Launched 17:03:32.470474 run osmo-stp_10.42.42.5(pid=8869): Launched 17:03:32.600141 run osmo-msc_10.42.42.6: Starting osmo-msc 17:03:33.175092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8871): Launched 17:03:33.511604 run osmo-msc_10.42.42.6(pid=8872): Launched 17:03:33.700603 run osmo-stp_10.42.42.5(pid=8869): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8869)] 17:03:33.840895 run osmo-stp_10.42.42.5(pid=8869): stdout: | (launched: 2022-12-13_17:03:32.408129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:33.981960 run osmo-stp_10.42.42.5(pid=8869): stderr: | [0;m[38;5;43m20221213170332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170332604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170332604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170332604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170332604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:34.121113 run osmo-stp_10.42.42.5(pid=8869): stdout: | (launched: 2022-12-13_17:03:32.408129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:34.254193 run osmo-stp_10.42.42.5(pid=8869): stderr: | [0;m[38;5;43m20221213170332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170332604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170332604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170332604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170332604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:34.413345 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8869): Process ended prematurely: osmo-stp_10.42.42.5(pid=8869) [trial-2391↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8869)] [trial-2391↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 17:03:34.422383 tst handover.py:18: Test FAILED (7.1 sec) 17:03:34.450813 run osmo-hlr_10.42.42.2(pid=8866): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8866)] 17:03:34.501681 run osmo-hlr_10.42.42.2(pid=8866): stdout: | (launched: 2022-12-13_17:03:31.118552) 17:03:34.553999 run osmo-hlr_10.42.42.2(pid=8866): stderr: | [0;m[1;31m20221213170331441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170331441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170331441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170331441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170331441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170331441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170331460 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170331477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170331477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170331477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:03:34.627357 run osmo-msc_10.42.42.6(pid=8872): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8872)] 17:03:34.677783 run osmo-msc_10.42.42.6(pid=8872): stdout: | (launched: 2022-12-13_17:03:33.449954) 17:03:34.730135 run osmo-msc_10.42.42.6(pid=8872): stderr: | [0;m[38;5;43m20221213170333774 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170333775 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb08d33cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170333775 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170333775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170333775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170333775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170333777 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170333777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170333778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170333778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:03:34.782748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8865): Terminating (SIGTERM) 17:03:34.824749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8868): Terminating (SIGTERM) 17:03:34.867856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8871): Terminating (SIGTERM) 17:03:34.910838 --- ParallelTerminationStrategy: PID 8865 died... 17:03:34.931579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8865): Terminated: ok {rc=0} 17:03:34.979146 --- ParallelTerminationStrategy: PID 8868 died... 17:03:34.999287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8868): Terminated: ok {rc=0} 17:03:35.046046 --- ParallelTerminationStrategy: PID 8871 died... 17:03:35.066178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8871): Terminated: ok {rc=0} 17:03:35.155645 bus /sierra_3: Setting Powered False 17:03:36.253614 bus /sierra_3: Setting Powered False 17:03:37.372269 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2391 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 17:03:38.632906 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:03:38.638216 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:03:38.703043 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:03:38.729900 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:03:38.784016 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:03:38.850175 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:03:38.878468 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:03:39.424538 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2391 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 17:03:39.431545 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:39.444204 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:03:39.493248 tst handover.py: using LAC 35045 17:03:39.623277 tst handover.py: using RAC 110 17:03:39.752516 tst handover.py: using CellId 35045 17:03:39.883327 tst handover.py: using BVCI 35046 17:03:40.005193 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:03:40.052272 tst handover.py: using LAC 35046 17:03:40.183485 tst handover.py: using RAC 111 17:03:40.312873 tst handover.py: using CellId 35046 17:03:40.436781 tst handover.py: using BVCI 35047 17:03:40.551321 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:40.562641 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:40.573698 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:40.584657 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:40.595906 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:03:40.607028 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:03:40.730366 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:03:40.852719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:03:41.311603 run create_hlr_db(pid=8877): Launched 17:03:41.433438 bus /sierra_2: Setting Powered False 17:03:42.495931 run create_hlr_db(pid=8877): Terminated: ok {rc=0} 17:03:42.925107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8879): Launched 17:03:43.262827 run osmo-hlr_10.42.42.2(pid=8880): Launched 17:03:43.392773 run osmo-stp_10.42.42.5: Starting osmo-stp 17:03:43.940627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8882): Launched 17:03:44.278865 run osmo-stp_10.42.42.5(pid=8883): Launched 17:03:44.408132 run osmo-msc_10.42.42.6: Starting osmo-msc 17:03:44.984687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8885): Launched 17:03:45.322766 run osmo-msc_10.42.42.6(pid=8886): Launched 17:03:45.515094 run osmo-stp_10.42.42.5(pid=8883): ERR: Terminated: ERROR {rc=1} [trial-2391↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8883)] 17:03:45.655395 run osmo-stp_10.42.42.5(pid=8883): stdout: | (launched: 2022-12-13_17:03:44.216703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:45.795810 run osmo-stp_10.42.42.5(pid=8883): stderr: | [0;m[38;5;43m20221213170344411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170344411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170344411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170344412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170344412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170344412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170344412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:45.952440 run osmo-stp_10.42.42.5(pid=8883): stdout: | (launched: 2022-12-13_17:03:44.216703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:46.092116 run osmo-stp_10.42.42.5(pid=8883): stderr: | [0;m[38;5;43m20221213170344411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213170344411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213170344411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213170344412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213170344412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213170344412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213170344412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:46.247252 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8883): Process ended prematurely: osmo-stp_10.42.42.5(pid=8883) [trial-2391↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8883)] [trial-2391↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 17:03:46.256660 tst handover.py:18: Test FAILED (6.8 sec) 17:03:46.285051 run osmo-hlr_10.42.42.2(pid=8880): ERR: Terminated: ERROR {rc=237} [trial-2391↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8880)] 17:03:46.339520 run osmo-hlr_10.42.42.2(pid=8880): stdout: | (launched: 2022-12-13_17:03:43.200416) 17:03:46.393028 run osmo-hlr_10.42.42.2(pid=8880): stderr: | [0;m[1;31m20221213170343403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213170343403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213170343403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213170343403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213170343403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213170343403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213170343415 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213170343424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213170343424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213170343424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:03:46.466068 run osmo-msc_10.42.42.6(pid=8886): ERR: Terminated: ERROR {rc=2} [trial-2391↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8886)] 17:03:46.518112 run osmo-msc_10.42.42.6(pid=8886): stdout: | (launched: 2022-12-13_17:03:45.260865) 17:03:46.571371 run osmo-msc_10.42.42.6(pid=8886): stderr: | [0;m[38;5;43m20221213170345586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213170345586 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5143304c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213170345586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213170345586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213170345586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213170345586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213170345588 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213170345589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213170345589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213170345589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:03:46.624745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8879): Terminating (SIGTERM) 17:03:46.668435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8882): Terminating (SIGTERM) 17:03:46.714488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8885): Terminating (SIGTERM) 17:03:46.760229 --- ParallelTerminationStrategy: PID 8879 died... 17:03:46.782028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8879): Terminated: ok {rc=0} 17:03:46.830765 --- ParallelTerminationStrategy: PID 8882 died... 17:03:46.851648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8882): Terminated: ok {rc=0} 17:03:46.900497 --- ParallelTerminationStrategy: PID 8885 died... 17:03:46.922217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8885): Terminated: ok {rc=0} 17:03:47.013198 bus /sierra_3: Setting Powered False 17:03:48.118010 bus /sierra_3: Setting Powered False 17:03:49.236280 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2391 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 17:03:50.512108 tst trial-2391: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391/run.2022-12-13_15-37-59/trial-2391.xml -------------------------------------------------------------------------------------------- trial-2391 FAIL -------------------------------------------------------------------------------------------- 17:03:52.464186 tst trial-2391: trial-2391: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.9 sec) Error: osmo-nitb_10.42.42.2(pid=1248): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1248) [trial-2391↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1248)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.4 sec) Error: osmo-stp_10.42.42.5(pid=1260): Process ended prematurely: osmo-stp_10.42.42.5(pid=1260) [trial-2391↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1260)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=1269): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1269) [trial-2391↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1269)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1279): Process ended prematurely: osmo-stp_10.42.42.5(pid=1279) [trial-2391↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1279)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1293): Process ended prematurely: osmo-stp_10.42.42.5(pid=1293) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1293)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1304): Process ended prematurely: osmo-stp_10.42.42.5(pid=1304) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1304)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1318): Process ended prematurely: osmo-stp_10.42.42.5(pid=1318) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1318)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1329): Process ended prematurely: osmo-stp_10.42.42.5(pid=1329) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1329)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1343): Process ended prematurely: osmo-stp_10.42.42.5(pid=1343) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1343)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1354): Process ended prematurely: osmo-stp_10.42.42.5(pid=1354) [trial-2391↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1354)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1372): Process ended prematurely: osmo-stp_10.42.42.5(pid=1372) [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1372)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1383): Process ended prematurely: osmo-stp_10.42.42.5(pid=1383) [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1383)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1397): Process ended prematurely: osmo-stp_10.42.42.5(pid=1397) [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1397)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1408): Process ended prematurely: osmo-stp_10.42.42.5(pid=1408) [trial-2391↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1408)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1422): Process ended prematurely: osmo-stp_10.42.42.5(pid=1422) [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1422)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1433): Process ended prematurely: osmo-stp_10.42.42.5(pid=1433) [trial-2391↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1433)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1447): Process ended prematurely: osmo-stp_10.42.42.5(pid=1447) [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1447)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1458): Process ended prematurely: osmo-stp_10.42.42.5(pid=1458) [trial-2391↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1458)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1472): Process ended prematurely: osmo-stp_10.42.42.5(pid=1472) [trial-2391↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1472)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1483): Process ended prematurely: osmo-stp_10.42.42.5(pid=1483) [trial-2391↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1483)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=1501): Process ended prematurely: osmo-stp_10.42.42.5(pid=1501) [trial-2391↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1501)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=1513): Process ended prematurely: osmo-stp_10.42.42.5(pid=1513) [trial-2391↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1513)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=1532): Process ended prematurely: osmo-stp_10.42.42.5(pid=1532) [trial-2391↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1532)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1542): Process ended prematurely: osmo-stp_10.42.42.5(pid=1542) [trial-2391↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1542)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1552): Process ended prematurely: osmo-stp_10.42.42.5(pid=1552) [trial-2391↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1552)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=1570): Process ended prematurely: osmo-stp_10.42.42.5(pid=1570) [trial-2391↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1570)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=1585): Process ended prematurely: osmo-stp_10.42.42.5(pid=1585) [trial-2391↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1585)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=1603): Process ended prematurely: osmo-stp_10.42.42.5(pid=1603) [trial-2391↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1603)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1613): Process ended prematurely: osmo-stp_10.42.42.5(pid=1613) [trial-2391↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1613)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1623): Process ended prematurely: osmo-stp_10.42.42.5(pid=1623) [trial-2391↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1623)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=1641): Process ended prematurely: osmo-stp_10.42.42.5(pid=1641) [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1641)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=1653): Process ended prematurely: osmo-stp_10.42.42.5(pid=1653) [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1653)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=1671): Process ended prematurely: osmo-stp_10.42.42.5(pid=1671) [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1671)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1681): Process ended prematurely: osmo-stp_10.42.42.5(pid=1681) [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1681)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1691): Process ended prematurely: osmo-stp_10.42.42.5(pid=1691) [trial-2391↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1691)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=1708): Process ended prematurely: osmo-stp_10.42.42.5(pid=1708) [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1708)] FAIL: iperf3.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=1720): Process ended prematurely: osmo-stp_10.42.42.5(pid=1720) [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1720)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=1738): Process ended prematurely: osmo-stp_10.42.42.5(pid=1738) [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1738)] FAIL: ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=1748): Process ended prematurely: osmo-stp_10.42.42.5(pid=1748) [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1748)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1758): Process ended prematurely: osmo-stp_10.42.42.5(pid=1758) [trial-2391↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1758)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1774): Process ended prematurely: osmo-stp_10.42.42.5(pid=1774) [trial-2391↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1774)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1788): Process ended prematurely: osmo-stp_10.42.42.5(pid=1788) [trial-2391↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1788)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=1796): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1796) [trial-2391↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1796)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1806): Process ended prematurely: osmo-stp_10.42.42.5(pid=1806) [trial-2391↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1806)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=1816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1816) [trial-2391↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1816)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1827): Process ended prematurely: osmo-stp_10.42.42.5(pid=1827) [trial-2391↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1827)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1841): Process ended prematurely: osmo-stp_10.42.42.5(pid=1841) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1841)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1852): Process ended prematurely: osmo-stp_10.42.42.5(pid=1852) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1852)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1866): Process ended prematurely: osmo-stp_10.42.42.5(pid=1866) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1866)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1877): Process ended prematurely: osmo-stp_10.42.42.5(pid=1877) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1877)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1892): Process ended prematurely: osmo-stp_10.42.42.5(pid=1892) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1892)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1903): Process ended prematurely: osmo-stp_10.42.42.5(pid=1903) [trial-2391↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1903)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1920): Process ended prematurely: osmo-stp_10.42.42.5(pid=1920) [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1920)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1933): Process ended prematurely: osmo-stp_10.42.42.5(pid=1933) [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1933)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1947): Process ended prematurely: osmo-stp_10.42.42.5(pid=1947) [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1947)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1958): Process ended prematurely: osmo-stp_10.42.42.5(pid=1958) [trial-2391↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1958)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1975): Process ended prematurely: osmo-stp_10.42.42.5(pid=1975) [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1975)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1988): Process ended prematurely: osmo-stp_10.42.42.5(pid=1988) [trial-2391↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1988)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2002): Process ended prematurely: osmo-stp_10.42.42.5(pid=2002) [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2002)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2013): Process ended prematurely: osmo-stp_10.42.42.5(pid=2013) [trial-2391↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2013)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2027): Process ended prematurely: osmo-stp_10.42.42.5(pid=2027) [trial-2391↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2027)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2038): Process ended prematurely: osmo-stp_10.42.42.5(pid=2038) [trial-2391↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2038)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=2056): Process ended prematurely: osmo-stp_10.42.42.5(pid=2056) [trial-2391↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2056)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=2068): Process ended prematurely: osmo-stp_10.42.42.5(pid=2068) [trial-2391↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2068)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=2086): Process ended prematurely: osmo-stp_10.42.42.5(pid=2086) [trial-2391↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2086)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2096): Process ended prematurely: osmo-stp_10.42.42.5(pid=2096) [trial-2391↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2096)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2106): Process ended prematurely: osmo-stp_10.42.42.5(pid=2106) [trial-2391↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2106)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=2124): Process ended prematurely: osmo-stp_10.42.42.5(pid=2124) [trial-2391↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2124)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=2136): Process ended prematurely: osmo-stp_10.42.42.5(pid=2136) [trial-2391↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2136)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=2154): Process ended prematurely: osmo-stp_10.42.42.5(pid=2154) [trial-2391↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2154)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2164): Process ended prematurely: osmo-stp_10.42.42.5(pid=2164) [trial-2391↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2164)] FAIL: ping_idle_ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=2445): Process ended prematurely: osmo-stp_10.42.42.5(pid=2445) [trial-2391↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2445)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=2464): Process ended prematurely: osmo-stp_10.42.42.5(pid=2464) [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2464)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=2477): Process ended prematurely: osmo-stp_10.42.42.5(pid=2477) [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2477)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=2495): Process ended prematurely: osmo-stp_10.42.42.5(pid=2495) [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2495)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2505): Process ended prematurely: osmo-stp_10.42.42.5(pid=2505) [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2505)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2516): Process ended prematurely: osmo-stp_10.42.42.5(pid=2516) [trial-2391↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2516)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=2536): Process ended prematurely: osmo-stp_10.42.42.5(pid=2536) [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2536)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=2548): Process ended prematurely: osmo-stp_10.42.42.5(pid=2548) [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2548)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=2568): Process ended prematurely: osmo-stp_10.42.42.5(pid=2568) [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2568)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2578): Process ended prematurely: osmo-stp_10.42.42.5(pid=2578) [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2578)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2591): Process ended prematurely: osmo-stp_10.42.42.5(pid=2591) [trial-2391↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2591)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=2604): Process ended prematurely: osmo-stp_10.42.42.5(pid=2604) [trial-2391↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2604)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=2617): Process ended prematurely: osmo-stp_10.42.42.5(pid=2617) [trial-2391↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2617)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=2628): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2628) [trial-2391↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2628)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2638): Process ended prematurely: osmo-stp_10.42.42.5(pid=2638) [trial-2391↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2638)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=2647): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2647) [trial-2391↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2647)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=2657): Process ended prematurely: osmo-stp_10.42.42.5(pid=2657) [trial-2391↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2657)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2671): Process ended prematurely: osmo-stp_10.42.42.5(pid=2671) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2671)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2682): Process ended prematurely: osmo-stp_10.42.42.5(pid=2682) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2682)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2696): Process ended prematurely: osmo-stp_10.42.42.5(pid=2696) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2696)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2707): Process ended prematurely: osmo-stp_10.42.42.5(pid=2707) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2707)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2721): Process ended prematurely: osmo-stp_10.42.42.5(pid=2721) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2721)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2732): Process ended prematurely: osmo-stp_10.42.42.5(pid=2732) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2732)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2747): Process ended prematurely: osmo-stp_10.42.42.5(pid=2747) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2747)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2758): Process ended prematurely: osmo-stp_10.42.42.5(pid=2758) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2758)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2774): Process ended prematurely: osmo-stp_10.42.42.5(pid=2774) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2774)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2785): Process ended prematurely: osmo-stp_10.42.42.5(pid=2785) [trial-2391↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2785)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2799): Process ended prematurely: osmo-stp_10.42.42.5(pid=2799) [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2799)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2810): Process ended prematurely: osmo-stp_10.42.42.5(pid=2810) [trial-2391↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2810)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2825): Process ended prematurely: osmo-stp_10.42.42.5(pid=2825) [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2825)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2837): Process ended prematurely: osmo-stp_10.42.42.5(pid=2837) [trial-2391↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2837)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2851): Process ended prematurely: osmo-stp_10.42.42.5(pid=2851) [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2851)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2862): Process ended prematurely: osmo-stp_10.42.42.5(pid=2862) [trial-2391↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2862)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2876): Process ended prematurely: osmo-stp_10.42.42.5(pid=2876) [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2876)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2897): Process ended prematurely: osmo-stp_10.42.42.5(pid=2897) [trial-2391↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2897)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3264): Process ended prematurely: osmo-stp_10.42.42.5(pid=3264) [trial-2391↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3264)] FAIL: emergency_preemptive_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=3451): Process ended prematurely: osmo-stp_10.42.42.5(pid=3451) [trial-2391↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3451)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=3470): Process ended prematurely: osmo-stp_10.42.42.5(pid=3470) [trial-2391↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3470)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=3483): Process ended prematurely: osmo-stp_10.42.42.5(pid=3483) [trial-2391↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3483)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=3501): Process ended prematurely: osmo-stp_10.42.42.5(pid=3501) [trial-2391↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3501)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3511): Process ended prematurely: osmo-stp_10.42.42.5(pid=3511) [trial-2391↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3511)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3521): Process ended prematurely: osmo-stp_10.42.42.5(pid=3521) [trial-2391↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3521)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=3538): Process ended prematurely: osmo-stp_10.42.42.5(pid=3538) [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3538)] FAIL: iperf3.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=3550): Process ended prematurely: osmo-stp_10.42.42.5(pid=3550) [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3550)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=3568): Process ended prematurely: osmo-stp_10.42.42.5(pid=3568) [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3568)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=3578): Process ended prematurely: osmo-stp_10.42.42.5(pid=3578) [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3578)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3588): Process ended prematurely: osmo-stp_10.42.42.5(pid=3588) [trial-2391↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3588)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=3605): Process ended prematurely: osmo-stp_10.42.42.5(pid=3605) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3605)] FAIL: iperf3.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=3618): Process ended prematurely: osmo-stp_10.42.42.5(pid=3618) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3618)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=3637): Process ended prematurely: osmo-stp_10.42.42.5(pid=3637) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3637)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=3647): Process ended prematurely: osmo-stp_10.42.42.5(pid=3647) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3647)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3657): Process ended prematurely: osmo-stp_10.42.42.5(pid=3657) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3657)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=3674): Process ended prematurely: osmo-stp_10.42.42.5(pid=3674) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3674)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=3686): Process ended prematurely: osmo-stp_10.42.42.5(pid=3686) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3686)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=3704): Process ended prematurely: osmo-stp_10.42.42.5(pid=3704) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3704)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3715): Process ended prematurely: osmo-stp_10.42.42.5(pid=3715) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3715)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3725): Process ended prematurely: osmo-stp_10.42.42.5(pid=3725) [trial-2391↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3725)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=3742): Process ended prematurely: osmo-stp_10.42.42.5(pid=3742) [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3742)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=3757): Process ended prematurely: osmo-stp_10.42.42.5(pid=3757) [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3757)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=3775): Process ended prematurely: osmo-stp_10.42.42.5(pid=3775) [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3775)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3785): Process ended prematurely: osmo-stp_10.42.42.5(pid=3785) [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3785)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3795): Process ended prematurely: osmo-stp_10.42.42.5(pid=3795) [trial-2391↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3795)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3812): Process ended prematurely: osmo-stp_10.42.42.5(pid=3812) [trial-2391↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3812)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3825): Process ended prematurely: osmo-stp_10.42.42.5(pid=3825) [trial-2391↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3825)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=3833): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3833) [trial-2391↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3833)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3843): Process ended prematurely: osmo-stp_10.42.42.5(pid=3843) [trial-2391↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3843)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=3852): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3852) [trial-2391↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3852)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3863): Process ended prematurely: osmo-stp_10.42.42.5(pid=3863) [trial-2391↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3863)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3878): Process ended prematurely: osmo-stp_10.42.42.5(pid=3878) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3878)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3889): Process ended prematurely: osmo-stp_10.42.42.5(pid=3889) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3889)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3903): Process ended prematurely: osmo-stp_10.42.42.5(pid=3903) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3903)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3914): Process ended prematurely: osmo-stp_10.42.42.5(pid=3914) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3914)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3928): Process ended prematurely: osmo-stp_10.42.42.5(pid=3928) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3928)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3939): Process ended prematurely: osmo-stp_10.42.42.5(pid=3939) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3939)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3953): Process ended prematurely: osmo-stp_10.42.42.5(pid=3953) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3953)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3964): Process ended prematurely: osmo-stp_10.42.42.5(pid=3964) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3964)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3978): Process ended prematurely: osmo-stp_10.42.42.5(pid=3978) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3978)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3989): Process ended prematurely: osmo-stp_10.42.42.5(pid=3989) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3989)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4003): Process ended prematurely: osmo-stp_10.42.42.5(pid=4003) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4003)] FAIL: mo_mt_call_osmux.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4042): Process ended prematurely: osmo-stp_10.42.42.5(pid=4042) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4042)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4300): Process ended prematurely: osmo-stp_10.42.42.5(pid=4300) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4300)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4311): Process ended prematurely: osmo-stp_10.42.42.5(pid=4311) [trial-2391↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4311)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4325): Process ended prematurely: osmo-stp_10.42.42.5(pid=4325) [trial-2391↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4325)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4336): Process ended prematurely: osmo-stp_10.42.42.5(pid=4336) [trial-2391↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4336)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=4357): Process ended prematurely: osmo-stp_10.42.42.5(pid=4357) [trial-2391↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4357)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4372): Process ended prematurely: osmo-stp_10.42.42.5(pid=4372) [trial-2391↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4372)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=4390): Process ended prematurely: osmo-stp_10.42.42.5(pid=4390) [trial-2391↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4390)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=4400): Process ended prematurely: osmo-stp_10.42.42.5(pid=4400) [trial-2391↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4400)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4410): Process ended prematurely: osmo-stp_10.42.42.5(pid=4410) [trial-2391↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4410)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=4429): Process ended prematurely: osmo-stp_10.42.42.5(pid=4429) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4429)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=4441): Process ended prematurely: osmo-stp_10.42.42.5(pid=4441) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4441)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=4459): Process ended prematurely: osmo-stp_10.42.42.5(pid=4459) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4459)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=4469): Process ended prematurely: osmo-stp_10.42.42.5(pid=4469) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4469)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4479): Process ended prematurely: osmo-stp_10.42.42.5(pid=4479) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4479)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=4496): Process ended prematurely: osmo-stp_10.42.42.5(pid=4496) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4496)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=4508): Process ended prematurely: osmo-stp_10.42.42.5(pid=4508) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4508)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=4526): Process ended prematurely: osmo-stp_10.42.42.5(pid=4526) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4526)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4536): Process ended prematurely: osmo-stp_10.42.42.5(pid=4536) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4536)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4546): Process ended prematurely: osmo-stp_10.42.42.5(pid=4546) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4546)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=4563): Process ended prematurely: osmo-stp_10.42.42.5(pid=4563) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4563)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=4575): Process ended prematurely: osmo-stp_10.42.42.5(pid=4575) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4575)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=4593): Process ended prematurely: osmo-stp_10.42.42.5(pid=4593) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4593)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4603): Process ended prematurely: osmo-stp_10.42.42.5(pid=4603) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4603)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4613): Process ended prematurely: osmo-stp_10.42.42.5(pid=4613) [trial-2391↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4613)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4628): Process ended prematurely: osmo-stp_10.42.42.5(pid=4628) [trial-2391↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4628)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=4642): Process ended prematurely: osmo-stp_10.42.42.5(pid=4642) [trial-2391↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4642)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=4656): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4656) [trial-2391↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4656)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4666): Process ended prematurely: osmo-stp_10.42.42.5(pid=4666) [trial-2391↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4666)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=4675): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4675) [trial-2391↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4675)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=4685): Process ended prematurely: osmo-stp_10.42.42.5(pid=4685) [trial-2391↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4685)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4699): Process ended prematurely: osmo-stp_10.42.42.5(pid=4699) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4699)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=4711): Process ended prematurely: osmo-stp_10.42.42.5(pid=4711) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4711)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4728): Process ended prematurely: osmo-stp_10.42.42.5(pid=4728) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4728)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4739): Process ended prematurely: osmo-stp_10.42.42.5(pid=4739) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4739)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4753): Process ended prematurely: osmo-stp_10.42.42.5(pid=4753) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4753)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4764): Process ended prematurely: osmo-stp_10.42.42.5(pid=4764) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4764)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4779): Process ended prematurely: osmo-stp_10.42.42.5(pid=4779) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4779)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4790): Process ended prematurely: osmo-stp_10.42.42.5(pid=4790) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4790)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4804): Process ended prematurely: osmo-stp_10.42.42.5(pid=4804) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4804)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4815): Process ended prematurely: osmo-stp_10.42.42.5(pid=4815) [trial-2391↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4815)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4829): Process ended prematurely: osmo-stp_10.42.42.5(pid=4829) [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4829)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4840): Process ended prematurely: osmo-stp_10.42.42.5(pid=4840) [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4840)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=4854): Process ended prematurely: osmo-stp_10.42.42.5(pid=4854) [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4854)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4868): Process ended prematurely: osmo-stp_10.42.42.5(pid=4868) [trial-2391↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4868)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4882): Process ended prematurely: osmo-stp_10.42.42.5(pid=4882) [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4882)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4893): Process ended prematurely: osmo-stp_10.42.42.5(pid=4893) [trial-2391↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4893)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4907): Process ended prematurely: osmo-stp_10.42.42.5(pid=4907) [trial-2391↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4907)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4918): Process ended prematurely: osmo-stp_10.42.42.5(pid=4918) [trial-2391↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4918)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=4936): Process ended prematurely: osmo-stp_10.42.42.5(pid=4936) [trial-2391↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4936)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=4950): Process ended prematurely: osmo-stp_10.42.42.5(pid=4950) [trial-2391↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4950)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=4968): Process ended prematurely: osmo-stp_10.42.42.5(pid=4968) [trial-2391↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4968)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4978): Process ended prematurely: osmo-stp_10.42.42.5(pid=4978) [trial-2391↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4978)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=4988): Process ended prematurely: osmo-stp_10.42.42.5(pid=4988) [trial-2391↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4988)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=5007): Process ended prematurely: osmo-stp_10.42.42.5(pid=5007) [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5007)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5019): Process ended prematurely: osmo-stp_10.42.42.5(pid=5019) [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5019)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=5037): Process ended prematurely: osmo-stp_10.42.42.5(pid=5037) [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5037)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5047): Process ended prematurely: osmo-stp_10.42.42.5(pid=5047) [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5047)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5060): Process ended prematurely: osmo-stp_10.42.42.5(pid=5060) [trial-2391↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5060)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=5080): Process ended prematurely: osmo-stp_10.42.42.5(pid=5080) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5080)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=5092): Process ended prematurely: osmo-stp_10.42.42.5(pid=5092) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5092)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=5110): Process ended prematurely: osmo-stp_10.42.42.5(pid=5110) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5110)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5121): Process ended prematurely: osmo-stp_10.42.42.5(pid=5121) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5121)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5131): Process ended prematurely: osmo-stp_10.42.42.5(pid=5131) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5131)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=5148): Process ended prematurely: osmo-stp_10.42.42.5(pid=5148) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5148)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5160): Process ended prematurely: osmo-stp_10.42.42.5(pid=5160) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5160)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=5178): Process ended prematurely: osmo-stp_10.42.42.5(pid=5178) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5178)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5188): Process ended prematurely: osmo-stp_10.42.42.5(pid=5188) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5188)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5198): Process ended prematurely: osmo-stp_10.42.42.5(pid=5198) [trial-2391↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5198)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=5215): Process ended prematurely: osmo-stp_10.42.42.5(pid=5215) [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5215)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5227): Process ended prematurely: osmo-stp_10.42.42.5(pid=5227) [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5227)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=5245): Process ended prematurely: osmo-stp_10.42.42.5(pid=5245) [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5245)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5257): Process ended prematurely: osmo-stp_10.42.42.5(pid=5257) [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5257)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5267): Process ended prematurely: osmo-stp_10.42.42.5(pid=5267) [trial-2391↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5267)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5281): Process ended prematurely: osmo-stp_10.42.42.5(pid=5281) [trial-2391↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5281)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5294): Process ended prematurely: osmo-stp_10.42.42.5(pid=5294) [trial-2391↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5294)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=5302): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5302) [trial-2391↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5302)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5312): Process ended prematurely: osmo-stp_10.42.42.5(pid=5312) [trial-2391↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5312)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=5592): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5592) [trial-2391↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5592)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=5608): Process ended prematurely: osmo-stp_10.42.42.5(pid=5608) [trial-2391↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5608)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5623): Process ended prematurely: osmo-stp_10.42.42.5(pid=5623) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5623)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5634): Process ended prematurely: osmo-stp_10.42.42.5(pid=5634) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5634)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5648): Process ended prematurely: osmo-stp_10.42.42.5(pid=5648) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5648)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5659): Process ended prematurely: osmo-stp_10.42.42.5(pid=5659) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5659)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5673): Process ended prematurely: osmo-stp_10.42.42.5(pid=5673) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5673)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5687): Process ended prematurely: osmo-stp_10.42.42.5(pid=5687) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5687)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5702): Process ended prematurely: osmo-stp_10.42.42.5(pid=5702) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5702)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5713): Process ended prematurely: osmo-stp_10.42.42.5(pid=5713) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5713)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5727): Process ended prematurely: osmo-stp_10.42.42.5(pid=5727) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5727)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5738): Process ended prematurely: osmo-stp_10.42.42.5(pid=5738) [trial-2391↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5738)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5756): Process ended prematurely: osmo-stp_10.42.42.5(pid=5756) [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5756)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5767): Process ended prematurely: osmo-stp_10.42.42.5(pid=5767) [trial-2391↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5767)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5781): Process ended prematurely: osmo-stp_10.42.42.5(pid=5781) [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5781)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5792): Process ended prematurely: osmo-stp_10.42.42.5(pid=5792) [trial-2391↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5792)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5806): Process ended prematurely: osmo-stp_10.42.42.5(pid=5806) [trial-2391↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5806)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5817): Process ended prematurely: osmo-stp_10.42.42.5(pid=5817) [trial-2391↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5817)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=5835): Process ended prematurely: osmo-stp_10.42.42.5(pid=5835) [trial-2391↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5835)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5847): Process ended prematurely: osmo-stp_10.42.42.5(pid=5847) [trial-2391↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5847)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=5865): Process ended prematurely: osmo-stp_10.42.42.5(pid=5865) [trial-2391↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5865)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5875): Process ended prematurely: osmo-stp_10.42.42.5(pid=5875) [trial-2391↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5875)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=5885): Process ended prematurely: osmo-stp_10.42.42.5(pid=5885) [trial-2391↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5885)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=5903): Process ended prematurely: osmo-stp_10.42.42.5(pid=5903) [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5903)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5915): Process ended prematurely: osmo-stp_10.42.42.5(pid=5915) [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5915)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=5933): Process ended prematurely: osmo-stp_10.42.42.5(pid=5933) [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5933)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5943): Process ended prematurely: osmo-stp_10.42.42.5(pid=5943) [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5943)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=5953): Process ended prematurely: osmo-stp_10.42.42.5(pid=5953) [trial-2391↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5953)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=5971): Process ended prematurely: osmo-stp_10.42.42.5(pid=5971) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5971)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=5985): Process ended prematurely: osmo-stp_10.42.42.5(pid=5985) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5985)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=6003): Process ended prematurely: osmo-stp_10.42.42.5(pid=6003) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6003)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6013): Process ended prematurely: osmo-stp_10.42.42.5(pid=6013) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6013)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6026): Process ended prematurely: osmo-stp_10.42.42.5(pid=6026) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6026)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=6043): Process ended prematurely: osmo-stp_10.42.42.5(pid=6043) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=6056): Process ended prematurely: osmo-stp_10.42.42.5(pid=6056) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6056)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=6074): Process ended prematurely: osmo-stp_10.42.42.5(pid=6074) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6074)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6091): Process ended prematurely: osmo-stp_10.42.42.5(pid=6091) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6091)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6102): Process ended prematurely: osmo-stp_10.42.42.5(pid=6102) [trial-2391↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6102)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6115): Process ended prematurely: osmo-stp_10.42.42.5(pid=6115) [trial-2391↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6115)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6128): Process ended prematurely: osmo-stp_10.42.42.5(pid=6128) [trial-2391↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6128)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6136): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6136) [trial-2391↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6136)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6146): Process ended prematurely: osmo-stp_10.42.42.5(pid=6146) [trial-2391↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6146)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6155): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6155) [trial-2391↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6155)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6165): Process ended prematurely: osmo-stp_10.42.42.5(pid=6165) [trial-2391↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6165)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6179): Process ended prematurely: osmo-stp_10.42.42.5(pid=6179) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6179)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6190): Process ended prematurely: osmo-stp_10.42.42.5(pid=6190) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6190)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6204): Process ended prematurely: osmo-stp_10.42.42.5(pid=6204) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6204)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6215): Process ended prematurely: osmo-stp_10.42.42.5(pid=6215) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6215)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6229): Process ended prematurely: osmo-stp_10.42.42.5(pid=6229) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6229)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6241): Process ended prematurely: osmo-stp_10.42.42.5(pid=6241) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6241)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6256): Process ended prematurely: osmo-stp_10.42.42.5(pid=6256) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6256)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6267): Process ended prematurely: osmo-stp_10.42.42.5(pid=6267) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6267)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6282): Process ended prematurely: osmo-stp_10.42.42.5(pid=6282) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6282)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6293): Process ended prematurely: osmo-stp_10.42.42.5(pid=6293) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6293)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6307): Process ended prematurely: osmo-stp_10.42.42.5(pid=6307) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6307)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6318): Process ended prematurely: osmo-stp_10.42.42.5(pid=6318) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6318)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6334): Process ended prematurely: osmo-stp_10.42.42.5(pid=6334) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6334)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6346): Process ended prematurely: osmo-stp_10.42.42.5(pid=6346) [trial-2391↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6346)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6360): Process ended prematurely: osmo-stp_10.42.42.5(pid=6360) [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6360)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6371): Process ended prematurely: osmo-stp_10.42.42.5(pid=6371) [trial-2391↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6371)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=6392): Process ended prematurely: osmo-stp_10.42.42.5(pid=6392) [trial-2391↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6392)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=6404): Process ended prematurely: osmo-stp_10.42.42.5(pid=6404) [trial-2391↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6404)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=6422): Process ended prematurely: osmo-stp_10.42.42.5(pid=6422) [trial-2391↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6422)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6432): Process ended prematurely: osmo-stp_10.42.42.5(pid=6432) [trial-2391↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6432)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6442): Process ended prematurely: osmo-stp_10.42.42.5(pid=6442) [trial-2391↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6442)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=6459): Process ended prematurely: osmo-stp_10.42.42.5(pid=6459) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6459)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6471): Process ended prematurely: osmo-stp_10.42.42.5(pid=6471) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6471)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=6489): Process ended prematurely: osmo-stp_10.42.42.5(pid=6489) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6489)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6499): Process ended prematurely: osmo-stp_10.42.42.5(pid=6499) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6499)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=6509): Process ended prematurely: osmo-stp_10.42.42.5(pid=6509) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6509)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=6526): Process ended prematurely: osmo-stp_10.42.42.5(pid=6526) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6526)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=6538): Process ended prematurely: osmo-stp_10.42.42.5(pid=6538) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6538)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=6556): Process ended prematurely: osmo-stp_10.42.42.5(pid=6556) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6556)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6566): Process ended prematurely: osmo-stp_10.42.42.5(pid=6566) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6566)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6576): Process ended prematurely: osmo-stp_10.42.42.5(pid=6576) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6576)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=6594): Process ended prematurely: osmo-stp_10.42.42.5(pid=6594) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6594)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=6606): Process ended prematurely: osmo-stp_10.42.42.5(pid=6606) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6606)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=6624): Process ended prematurely: osmo-stp_10.42.42.5(pid=6624) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6624)] FAIL: ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6906): Process ended prematurely: osmo-stp_10.42.42.5(pid=6906) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6906)] FAIL: ping_idle_ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=6916): Process ended prematurely: osmo-stp_10.42.42.5(pid=6916) [trial-2391↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6916)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=6932): Process ended prematurely: osmo-stp_10.42.42.5(pid=6932) [trial-2391↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6932)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6945): Process ended prematurely: osmo-stp_10.42.42.5(pid=6945) [trial-2391↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6945)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6953): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6953) [trial-2391↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6953)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6963): Process ended prematurely: osmo-stp_10.42.42.5(pid=6963) [trial-2391↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6963)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=6972): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6972) [trial-2391↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6972)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=6985): Process ended prematurely: osmo-stp_10.42.42.5(pid=6985) [trial-2391↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6985)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6999): Process ended prematurely: osmo-stp_10.42.42.5(pid=6999) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6999)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7010): Process ended prematurely: osmo-stp_10.42.42.5(pid=7010) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7010)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7024): Process ended prematurely: osmo-stp_10.42.42.5(pid=7024) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7024)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7035): Process ended prematurely: osmo-stp_10.42.42.5(pid=7035) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7035)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7051): Process ended prematurely: osmo-stp_10.42.42.5(pid=7051) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7051)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7062): Process ended prematurely: osmo-stp_10.42.42.5(pid=7062) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7062)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7076): Process ended prematurely: osmo-stp_10.42.42.5(pid=7076) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7076)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7087): Process ended prematurely: osmo-stp_10.42.42.5(pid=7087) [trial-2391↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7087)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7101): Process ended prematurely: osmo-stp_10.42.42.5(pid=7101) [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7101)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7112): Process ended prematurely: osmo-stp_10.42.42.5(pid=7112) [trial-2391↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7112)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=7128): Process ended prematurely: osmo-stp_10.42.42.5(pid=7128) [trial-2391↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7128)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7139): Process ended prematurely: osmo-stp_10.42.42.5(pid=7139) [trial-2391↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7139)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=7157): Process ended prematurely: osmo-stp_10.42.42.5(pid=7157) [trial-2391↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7157)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=7169): Process ended prematurely: osmo-stp_10.42.42.5(pid=7169) [trial-2391↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7169)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=7187): Process ended prematurely: osmo-stp_10.42.42.5(pid=7187) [trial-2391↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7187)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7197): Process ended prematurely: osmo-stp_10.42.42.5(pid=7197) [trial-2391↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7197)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7207): Process ended prematurely: osmo-stp_10.42.42.5(pid=7207) [trial-2391↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7207)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=7224): Process ended prematurely: osmo-stp_10.42.42.5(pid=7224) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7224)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=7236): Process ended prematurely: osmo-stp_10.42.42.5(pid=7236) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7236)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=7254): Process ended prematurely: osmo-stp_10.42.42.5(pid=7254) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7254)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7264): Process ended prematurely: osmo-stp_10.42.42.5(pid=7264) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7264)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7274): Process ended prematurely: osmo-stp_10.42.42.5(pid=7274) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7274)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=7294): Process ended prematurely: osmo-stp_10.42.42.5(pid=7294) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7294)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=7306): Process ended prematurely: osmo-stp_10.42.42.5(pid=7306) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7306)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=7324): Process ended prematurely: osmo-stp_10.42.42.5(pid=7324) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7324)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7337): Process ended prematurely: osmo-stp_10.42.42.5(pid=7337) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7337)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7347): Process ended prematurely: osmo-stp_10.42.42.5(pid=7347) [trial-2391↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7347)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7360): Process ended prematurely: osmo-stp_10.42.42.5(pid=7360) [trial-2391↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7360)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7373): Process ended prematurely: osmo-stp_10.42.42.5(pid=7373) [trial-2391↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7373)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7383): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7383) [trial-2391↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7383)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7394): Process ended prematurely: osmo-stp_10.42.42.5(pid=7394) [trial-2391↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7394)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7408): Process ended prematurely: osmo-stp_10.42.42.5(pid=7408) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7408)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7419): Process ended prematurely: osmo-stp_10.42.42.5(pid=7419) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7419)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7433): Process ended prematurely: osmo-stp_10.42.42.5(pid=7433) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7433)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7444): Process ended prematurely: osmo-stp_10.42.42.5(pid=7444) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7444)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7458): Process ended prematurely: osmo-stp_10.42.42.5(pid=7458) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7458)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7469): Process ended prematurely: osmo-stp_10.42.42.5(pid=7469) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7469)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7483): Process ended prematurely: osmo-stp_10.42.42.5(pid=7483) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7483)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7494): Process ended prematurely: osmo-stp_10.42.42.5(pid=7494) [trial-2391↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7494)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7510): Process ended prematurely: osmo-stp_10.42.42.5(pid=7510) [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7510)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7521): Process ended prematurely: osmo-stp_10.42.42.5(pid=7521) [trial-2391↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7521)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7541): Process ended prematurely: osmo-stp_10.42.42.5(pid=7541) [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7541)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7552): Process ended prematurely: osmo-stp_10.42.42.5(pid=7552) [trial-2391↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7552)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7566): Process ended prematurely: osmo-stp_10.42.42.5(pid=7566) [trial-2391↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7566)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7577): Process ended prematurely: osmo-stp_10.42.42.5(pid=7577) [trial-2391↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7577)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=7595): Process ended prematurely: osmo-stp_10.42.42.5(pid=7595) [trial-2391↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7595)] FAIL: iperf3.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=7607): Process ended prematurely: osmo-stp_10.42.42.5(pid=7607) [trial-2391↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7607)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=7625): Process ended prematurely: osmo-stp_10.42.42.5(pid=7625) [trial-2391↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7625)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7635): Process ended prematurely: osmo-stp_10.42.42.5(pid=7635) [trial-2391↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7635)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7646): Process ended prematurely: osmo-stp_10.42.42.5(pid=7646) [trial-2391↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7646)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=7663): Process ended prematurely: osmo-stp_10.42.42.5(pid=7663) [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7663)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=7678): Process ended prematurely: osmo-stp_10.42.42.5(pid=7678) [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7678)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=7696): Process ended prematurely: osmo-stp_10.42.42.5(pid=7696) [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7696)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=7706): Process ended prematurely: osmo-stp_10.42.42.5(pid=7706) [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7706)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7716): Process ended prematurely: osmo-stp_10.42.42.5(pid=7716) [trial-2391↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7716)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=7734): Process ended prematurely: osmo-stp_10.42.42.5(pid=7734) [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7734)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=7746): Process ended prematurely: osmo-stp_10.42.42.5(pid=7746) [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7746)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7765): Process ended prematurely: osmo-stp_10.42.42.5(pid=7765) [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7765)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7775): Process ended prematurely: osmo-stp_10.42.42.5(pid=7775) [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7775)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7785): Process ended prematurely: osmo-stp_10.42.42.5(pid=7785) [trial-2391↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7785)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7802): Process ended prematurely: osmo-stp_10.42.42.5(pid=7802) [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7802)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=7814): Process ended prematurely: osmo-stp_10.42.42.5(pid=7814) [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7814)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=7832): Process ended prematurely: osmo-stp_10.42.42.5(pid=7832) [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7832)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7842): Process ended prematurely: osmo-stp_10.42.42.5(pid=7842) [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7842)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7854): Process ended prematurely: osmo-stp_10.42.42.5(pid=7854) [trial-2391↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7854)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7867): Process ended prematurely: osmo-stp_10.42.42.5(pid=7867) [trial-2391↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7867)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=7876): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7876) [trial-2391↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7876)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=7878): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7878) [trial-2391↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7878)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=7880): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7880) [trial-2391↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7880)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7882): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7882) [trial-2391↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7882)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.7 sec) Error: osmo-hlr_10.42.42.2(pid=7891): Process ended prematurely: osmo-hlr_10.42.42.2(pid=7891) [trial-2391↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7891)] FAIL: esme_connect_policy_closed.py (6.0 sec) Error: osmo-hlr_10.42.42.2(pid=7902): Process ended prematurely: osmo-hlr_10.42.42.2(pid=7902) [trial-2391↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7902)] FAIL: esme_ms_sms_storeforward.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7914): Process ended prematurely: osmo-stp_10.42.42.5(pid=7914) [trial-2391↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7914)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7925): Process ended prematurely: osmo-stp_10.42.42.5(pid=7925) [trial-2391↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7925)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=8013): Process ended prematurely: osmo-stp_10.42.42.5(pid=8013) [trial-2391↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8013)] FAIL: register_a5_0_authreq.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8223): Process ended prematurely: osmo-stp_10.42.42.5(pid=8223) [trial-2391↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8223)] FAIL: register_a5_1_authreq.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8234): Process ended prematurely: osmo-stp_10.42.42.5(pid=8234) [trial-2391↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8234)] FAIL: register_a5_3_authreq.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8245): Process ended prematurely: osmo-stp_10.42.42.5(pid=8245) [trial-2391↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8245)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.4 sec) Error: srsepc(pid=8267): Process ended prematurely: srsepc(pid=8267) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8267)] FAIL: iperf3_bidir.py (19.1 sec) Error: srsepc(pid=8284): Process ended prematurely: srsepc(pid=8284) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8284)] FAIL: iperf3_dl.py (19.0 sec) Error: srsepc(pid=8303): Process ended prematurely: srsepc(pid=8303) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8303)] FAIL: iperf3_ul.py (19.2 sec) Error: srsepc(pid=8319): Process ended prematurely: srsepc(pid=8319) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8319)] FAIL: ping.py (19.1 sec) Error: srsepc(pid=8339): Process ended prematurely: srsepc(pid=8339) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8339)] FAIL: rrc_idle_mo_ping.py (18.7 sec) Error: srsepc(pid=8355): Process ended prematurely: srsepc(pid=8355) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8355)] FAIL: rrc_idle_mt_ping.py (18.8 sec) Error: srsepc(pid=8371): Process ended prematurely: srsepc(pid=8371) [trial-2391↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=8371)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8384): Process ended prematurely: osmo-stp_10.42.42.5(pid=8384) [trial-2391↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8384)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8398): Process ended prematurely: osmo-stp_10.42.42.5(pid=8398) [trial-2391↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8398)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8412): Process ended prematurely: osmo-stp_10.42.42.5(pid=8412) [trial-2391↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8412)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8426): Process ended prematurely: osmo-stp_10.42.42.5(pid=8426) [trial-2391↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8426)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8440): Process ended prematurely: osmo-stp_10.42.42.5(pid=8440) [trial-2391↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8440)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=8454): Process ended prematurely: osmo-stp_10.42.42.5(pid=8454) [trial-2391↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8454)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=8468): Process ended prematurely: osmo-stp_10.42.42.5(pid=8468) [trial-2391↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8468)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8482): Process ended prematurely: osmo-stp_10.42.42.5(pid=8482) [trial-2391↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8482)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8496): Process ended prematurely: osmo-stp_10.42.42.5(pid=8496) [trial-2391↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8496)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8510): Process ended prematurely: osmo-stp_10.42.42.5(pid=8510) [trial-2391↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8510)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8525): Process ended prematurely: osmo-stp_10.42.42.5(pid=8525) [trial-2391↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8525)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=8539): Process ended prematurely: osmo-stp_10.42.42.5(pid=8539) [trial-2391↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8553): Process ended prematurely: osmo-stp_10.42.42.5(pid=8553) [trial-2391↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8553)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8567): Process ended prematurely: osmo-stp_10.42.42.5(pid=8567) [trial-2391↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8567)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8582): Process ended prematurely: osmo-stp_10.42.42.5(pid=8582) [trial-2391↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8582)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=8596): Process ended prematurely: osmo-stp_10.42.42.5(pid=8596) [trial-2391↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8596)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8611): Process ended prematurely: osmo-stp_10.42.42.5(pid=8611) [trial-2391↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8611)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8629): Process ended prematurely: osmo-stp_10.42.42.5(pid=8629) [trial-2391↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8629)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8643): Process ended prematurely: osmo-stp_10.42.42.5(pid=8643) [trial-2391↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8643)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8657): Process ended prematurely: osmo-stp_10.42.42.5(pid=8657) [trial-2391↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8657)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8671): Process ended prematurely: osmo-stp_10.42.42.5(pid=8671) [trial-2391↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8671)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8686): Process ended prematurely: osmo-stp_10.42.42.5(pid=8686) [trial-2391↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8686)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8700): Process ended prematurely: osmo-stp_10.42.42.5(pid=8700) [trial-2391↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8700)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8714): Process ended prematurely: osmo-stp_10.42.42.5(pid=8714) [trial-2391↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8714)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8728): Process ended prematurely: osmo-stp_10.42.42.5(pid=8728) [trial-2391↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8728)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=8742): Process ended prematurely: osmo-stp_10.42.42.5(pid=8742) [trial-2391↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8742)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8756): Process ended prematurely: osmo-stp_10.42.42.5(pid=8756) [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8756)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8770): Process ended prematurely: osmo-stp_10.42.42.5(pid=8770) [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8770)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8784): Process ended prematurely: osmo-stp_10.42.42.5(pid=8784) [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8784)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8798): Process ended prematurely: osmo-stp_10.42.42.5(pid=8798) [trial-2391↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8798)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=8812): Process ended prematurely: osmo-stp_10.42.42.5(pid=8812) [trial-2391↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8812)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8826): Process ended prematurely: osmo-stp_10.42.42.5(pid=8826) [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8826)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8841): Process ended prematurely: osmo-stp_10.42.42.5(pid=8841) [trial-2391↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8841)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8855): Process ended prematurely: osmo-stp_10.42.42.5(pid=8855) [trial-2391↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8855)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=8869): Process ended prematurely: osmo-stp_10.42.42.5(pid=8869) [trial-2391↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8869)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8883): Process ended prematurely: osmo-stp_10.42.42.5(pid=8883) [trial-2391↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8883)] + rm -rf trial-2391/inst + cd trial-2391 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-13 15:37:47 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391-run.tgz run.2022-12-13_15-37-59 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2391-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17680.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2986.tgz osmo-mgw.build-8959.tgz osmo-msc.build-29305.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30089.tgz osmo-stp.build-9255.tgz osmo-trx.build-4683.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE